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Abstract 

A  method  is  presented  that  attempts  to  isolate  the  relative  magnitudes  of  various  er¬ 
ror  sourees  present  in  eommon  algorithms  for  inverting  the  effeets  of  atmospherie 
seattering  and  absorption  on  solar  irradianee  and  determine  in  what  ways,  if  any, 
operational  ground  truth  measurement  systems  ean  be  employed  to  reduee  the  over¬ 
all  error  in  retrieved  refleetanee  faetor.  Error  modeling  and  propagation  methodol¬ 
ogy  is  developed  for  eaeh  link  in  the  imaging  ehain,  and  representative  values  are 
determined  for  the  purpose  of  exereising  the  model  and  observing  the  system  be¬ 
havior  in  response  to  a  wide  variety  of  inputs.  Three  distinet  approaehes  to  model- 
based  atmospherie  inversion  are  eompared  in  a  eommon  refleetanee  error  spaee, 
where  eaeh  eontributor  to  the  overall  error  in  retrieved  refleetanee  is  examined  in 
relation  to  the  others.  The  modeling  framework  also  allows  for  performanee  predie- 
tions  resulting  from  the  ineorporation  of  operational  ground  truth  measurements. 
Regimes  were  identified  in  whieh  uneertainty  in  water  vapor  and  aerosols  were 
eaeh  found  to  dominate  error  eontributions  to  final  retrieved  refleetanee.  Cloud 
eover  was  also  shown  to  be  a  signifieant  eontributor,  while  state-of-the-industry 
hyperspeetral  sensors  were  eonfirmed  to  not  be  error  drivers.  Aeeordingly,  instru¬ 
ments  for  measuring  water  vapor,  aerosols,  and  downwelled  sky  radianee  were 
identified  as  key  to  improving  refleetanee  retrieval  beyond  eurrent  performanee  by 
eurrent  inversion  algorithms. 
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Chapter  1 

Introduction 


The  story  of  remote  sensing  has  been  one  of  steady  teehnologieal  innovation, 
evolving  image  proeessing  and  data  extraetion  teehniques,  and  branehing  appli- 
eations.  Eaeh  new  generation  of  teehnology  builds  on  needs  that  have  emerged 
from  the  previous  generation’s  remote  sensing  applieations  and  data  proeessing 
methods  and,  in  turn,  prompts  new  application  branches  and  new  data  extraction 
capabilities.  Taking  photographs  from  a  balloon,  first  documented  in  1858,  pre¬ 
dates  the  US  Civil  War,  and  this  capability  led  to  the  employment  of  battlefield 
surveillance  fechniques  during  fhe  war.  The  invenfion  of  fhe  firsl  modern  cam¬ 
era  in  1888  (including  flexible  rolled  film  and  sfandardized  chemical  processing) 
and  powered  flighl  shorfly  Ihereafler  enabled  fhe  firsl  Irue  aerial  photography,  em¬ 
ployed  in  World  War  I  and  II.  The  invenfion  of  color  infrared  film  nol  only  had 
applications  in  delecting  camouflage  buf  also  vegelalion  heallh.  This  discovery  in 
fhe  mid-1950’s  eslablished  fhe  ulilily  of  remote  sensing  in  agricullural  research 
(Campbell,  1987). 

The  spiral  evolulion  of  remole  sensing  has  confinued  wilh  salellile  phologra- 
phy,  digilal  imaging,  mullispecfral,  mullilemporal,  and  mosl  recenlly  hyperspec- 
Iral  imaging.  The  Corona  projecl,  fhe  exislence  of  which  was  made  public  in  1995, 
marked  fhe  firsl  lime  remote  sensing  was  conducled  from  space  -  fhe  resull  of  which 
is  shown  in  figure  1.1.  This  excerpl  from  a  1960  memorandum  to  fhe  US  Intelli¬ 
gence  Board  illuslrales  fhe  relalionship  belween  needs,  lechnology,  applicalions, 
and  exploilalion: 

For  six  years  fhe  U.  S.  inlelligence  agencies  have  had  exlensive  ex¬ 
perience  wilh  fhe  larger  scale  photography  from  overflighl  held  in  fhe 
[redacted]  and  TALENT  Syslems.  New  equipmenl  bearing  upon  fhe 
arl  of  photographic  inlerprelafion  has  clearly  expanded  fhe  quantify 


1 


2 


CHAPTER  1.  INTRODUCTION 


and  quality  of  information  derived  from  that  photography.  We  have 
seen  the  extensive  uses  to  which  the  material  and  the  information  de¬ 
rived  therefrom  can  be  put  for  strategic  intelligence  purposes,  emer¬ 
gency  war  planning,  intelligence  purpose  related  to  the  responsibility 
of  theater  commanders,  research  and  development  requirements  of  the 
Department  of  Defense,  and  operational  purposes  of  the  military  as 
well  as  intelligence  operations  (Ruffner,  1995). 


(a)  First  satellite  photo  ever  taken  (Corona  (b)  Modern  satellite  image  of  the  same  subject 
project,  August  18, 1960) 


Figure  1.1:  Soviet  Airstrip  at  68°53'N  179°24'W 


Near  the  end  of  the  Corona  satellite  program,  the  National  Photographic  In¬ 
terpretation  Center  (NPIC)  expressed  an  opinion  that  color  photography  from  a 
satellite  platform  could  be  useful  for  non-military  uses.  The  1971  report  provided 
strong  evidence  that  global  land  observation  for  geological  classification,  mapping, 
and  other  purposes  would  be  extremely  useful  and  highly  beneficial.  The  secfion 
enfifled  “The  Value  of  Color  Cannof  Be  Oversfafed”  hinfs  af  fhe  lafer-discovered 
uses  of  mulfispecfral  and  hyperspecfral  imagery  (Ruffner,  1995).  The  LandSAT 
program,  fhe  producf  of  a  decade’s  research  by  NASA  and  fhe  National  Academy 
of  Sciences,  was  initialed  fhe  very  nexl  year  as  a  syslemalic  and  repealable  earlh 
observation  program.  The  space  vehicles  and  Iheir  dala  producls,  shown  in  fig¬ 
ure  1.2,  revolulionized  many  fields,  including  ground  mapping,  geology,  foreslry. 
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agriculture  and  soil  quality,  and  land  use  (Campbell,  1987).  Later  developments  in 
digital  imagery,  imaging  spectroscopy,  and  automated  data  processing  continued 
the  trends  traced  thus  far  in  the  history  of  remote  sensing. 

The  inherent  strengths  of  remote  sensing — the  potential  to  operate  on  large 
geographic  areas  at  one  time,  access  to  otherwise  inaccessible  or  denied  areas, 
and  standoff  distance — point  to  what  may  be  thought  of  as  proper  or  improper 
applications  of  the  discipline.  However,  as  has  been  shown  so  far,  new  application 
areas  can  be  opened  up  as  a  result  of  novel  uses  of  technology  and  processing.  It  has 
long  been  taken  for  granted  that  the  proper  role  of  ground  truth  in  remote  sensing 
is  strictly  limited  to  support  roles:  instrument  calibration,  basic  phenomenology 
research,  and  algorithm  development/validation.  Ground  truth  takes  many  forms, 
including  measurement  of  ground  material  properties,  radiometric  quantities  in  the 
sky,  and  atmospheric  constituency,  and  all  are  generally  deemed  to  be  too  expensive 
and  too  burdensome  to  routinely  measure  as  part  of  an  operational  remote  sensing 
activity.  After  all,  if  it  were  viable  to  simply  “sense,”  there  would  be  no  need  to 
“remotely  sense.” 


Nadir 


(a)  LandSAT  VII  space  vehicle 


(b)  First  LandSAT  VII  image 


Figure  1.2:  Launched  in  1999,  the  LandSAT  VII  platform  continues  the  34-year- 

old  Earth  observing  program. 


However,  enabling  technology  has  recently  developed  such  that  networks  of 
ground  truth  sensors  deployed  in  conjunction  with  remote  sensing  image  data  col¬ 
lection  deserve  reconsideration.  These  technologies  are  inexpensive  wireless  com¬ 
munication  and  computer  chips.  The  products  are  sensors  that  can  be  manufactured 
cheaply,  ruggedized  or  be  made  disposable,  left  unattended,  and  remotely  commii- 
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nicated  with.  These  sensors,  in  effect,  can  become  remote  sensors.  Networking 
these  sensors  produces  a  remote  sensing  system  -  not  one  that  collects  imagery 
data,  but  one  that  collects  data  in  one  of  several  different  modes. 

While  novel,  systems  of  this  type  are  not  unheard  of.  Such  a  multi-modal 
system  is  notionally  depicted  in  figure  1.3,  in  which  inexpensive  autonomous  wild¬ 
fire  defecfion  and  monitoring  sensors  consfrucfed  from  common  commercially- 
available  componenfs  are  arrayed  fhroughouf  a  wide  geographic  area.  Overhead 
mulfispecfral  imagery  provides  an  uncalibrafed  heaf  release  map  over  fhe  enfire 
area  while  fhe  ground  sensors  provide  necessary  calibrafion  informafion.  Togefher, 
fhe  fused  imaging  and  non-imaging  dafa  allow  an  esfimafe  of  fuel  consumpfion  and 
ofher  burn  characferisfics  of  scientific  and  pracfical  inferesf  (Kremens  ef  ah,  2005). 


(a)  Photograph  of  a  prototype  au-  (b)  Autonomous  fire  detection  network  concept  illustra- 
tonomous  fire  detector  tion 


Figure  1.3:  Example  of  an  inexpensive,  arrayed,  unattended  sensor  system  (Kre¬ 
mens  et  ah,  2003). 


It  is  hypothesized  that  proper  application  of  this  concept  to  other  remote  sens¬ 
ing  research  areas  can  produce  significant  performance  gains  for  the  application 
and  poses  the  potential  to  stimulate  the  upward  spiral  of  remote  sensing  application 
development  through  the  operational  use  of  multi-modal  sensing.  Finding  ways  to 
combine  non-imaging  data  from  a  sensor  network  with  imaging  data  results  in  a 
system  of  systems  geared  to  provide  novel  capabilities  that  serve  both  research  and 
operational  interests.  Ideally,  the  design  of  the  system  would  be  focused  on  the 
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final  information  product  rather  than  on  the  modality  chosen,  though  there  may  be 
limits  to  the  usefulness  of  such  a  high  level  of  abstraction. 

At  the  practical  level,  atmospheric  inversion  is  one  of  the  most  active  areas, 
indeed  a  primary  motivation,  of  remote  sensing  research.  Removing  the  effects 
of  the  atmosphere  on  photons  coming  from  a  known  source  and  reflecting  off  an 
unknown  target  allows  the  identification  of  the  ground  material’s  reflectance  spec¬ 
trum,  which  is,  in  essence,  one  type  of  fingerprint  of  the  material’s  nature.  The 
reflectance  spectrum  is  an  intermediate  remote  sensing  data  product  that  is  used  to 
find  many  derivative  data  products  and  acts  as  a  gateway  to  a  host  of  applications, 
including  land  classification,  land  or  water  quality,  anomaly  and  target  detection, 
and  others.  It  is  also  widely  accepted  that  reducing  imaging  data  to  reflectance 
spectra  provides  a  time-stable  common  foundation  for  working  with  imaging  data 
and  is  an  inherently  valuable  task. 

Boardman  (1990)  describes  the  components  the  inversion  process:  the  ob¬ 
served  data  and  the  modeling  of  physical  operators  can  be  combined  to  predict 
the  original  controlling  parameters  that  produced  the  original  observations.  To  this 
process  he  adds  ancillary  data  and  error  models.  It  is  common  to  introduce  an¬ 
cillary  data  to  enhance,  enable,  or  validate  the  radiance-to-reflectance  inversion. 
Not  only  does  ground  truth  spectra  or  other  ground  measurement  unlock  certain 
types  of  inversion  models,  fusing  ground  truth  into  image  processing  algorithms 
can  result  in  an  overall  increase  in  precision  in  the  data  product. 

The  inclusion  of  error  models  in  the  inversion  process  is  somewhat  curious. 
Considering  the  random  side  of  error,  it  is  impossible  to  predict  with  an  error  model 
the  exact  value  of  the  noise  perturbation  for  any  particular  link  in  the  imaging  chain 
at  any  given  time.  Time  averaging  is  used  to  reduce  random  error,  but  even  if  it 
were  not  made  problematic  by  the  constantly-changing  remote  sensing  environ¬ 
ment,  it  renders  moot  the  need  for  error  models.  Use  of  ancillary  measurements 
precise  enough  to  determine  controlling  parameters  below  the  noise  threshold  of 
the  remote  sensing  instrument  has  the  same  effect.  Error  models  are  therefore  not 
used  to  produce  the  inversion  results. 

On  the  other  hand,  use  of  error  models  to  predict  uncertainty  in  retrieved  re¬ 
flectance  is  both  possible  and  necessary.  Despite  the  explicit  inclusion  of  error 
models  in  this  foundational  description  of  what  hyperspectral  inversion  is  and  how 
it  should  be  carried  out,  this  step  is  not  accomplished.  In  literature  on  the  sub¬ 
ject  there  are  perhaps  three  trends.  Often  the  author  explains  why  the  assumptions 
used  are  minor  enough  such  that  the  error  will  be  negligible;  it  is  then  ignored. 
Alternately,  authors  take  a  ground  truth  measurement,  compare  it  to  one  or  more 
retrieved  spectra,  and  assume  the  discrepancy  to  be  typical  and  repeatable.  The 
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final  category  is  the  not  uncommon  sensitivity  study,  where  changes  in  one  param¬ 
eter  are  observed  to  have  a  corresponding  change  in  the  final  result.  Griffin  and 
Burke  (2003)  performed  a  fairly  detailed  study  of  this  sort,  comparing  the  perfor¬ 
mance  of  two  hyperspectral  inversion  algorithms  in  response  to  changes  in  water 
vapor  determination  method,  aerosol  model,  aerosol  quantity,  atmospheric  model 
type,  and  solar  zenith  angle.  In  each  case,  a  variation  in  a  parameter  is  related  to 
a  resulting  error  in  the  retrieved  surface  reflectance,  which  varied  from  ±1-10%. 
While  useful  and  important,  it  is  difficult  to  translate  sensitivity  studies  like  into 
a  framework  that  demonstrates  how  the  entire  system  of  variables  functions  as  a 
whole.  This  type  of  “direct  pass-through”  study  does  not  use  the  statistical  lan¬ 
guage  of  errors,  nor  does  it  place  the  input  perturbations  into  a  meaningful  context. 
It  is  argued  here  that  none  of  these  approaches  employs  error  modeling  in  a  man¬ 
ner  that  attaches  uncertainty  to  the  “estimates  of  controlling  parameters  of  interest” 
(Boardman,  1990). 

A  different  approach  was  taken  by  Kerekes  (1998)  to  describe,  quantify,  and 
analyze  sources  of  error  using  statistical  language.  By  analyzing  hyperspectral 
imagery  containing  large  calibration  panels,  the  author  was  able  to  use  multiple 
pixels  accompanied  by  ground  truth  to  create  a  data  set  subject  to  statistical  analy¬ 
sis.  Two  methods  of  obtaining  the  surface  properties  were  exercised,  resulting  in  an 
estimate  of  both  random  error,  expressed  as  the  standard  deviation  of  a  probability 
distribution  (on  the  order  of  1-2%),  and  any  bias  present  in  the  system  (found  for 
one  of  the  methods  to  be  on  the  order  of  1-4%).  There  was  a  desire  expressed  to 
understand  how  each  of  several  sources  of  error,  including  water  vapor  estimation 
error  and  sensor  effects,  contributed  to  uncertainty  in  the  final  result.  However, 
without  a  way  to  link  error  in  precursor  sources  to  the  final  product,  there  are  some 
limitations  on  how  well  these  sensitivities  can  be  studied  and  expressed.  As  a 
foundational  work,  this  is  an  excellent  starting  point.  It  is  precisely  the  goal  here 
to  express  the  retrieval  of  surface  properties  in  the  same  statistical  language  and 
accurately  model  the  contributions  of  individual  sources.  Extending  this  work  in¬ 
volves  the  introduction  of  a  method  of  modeling  error  in  each  source,  propagating 
it  through  the  non-linear  imaging  system,  and  expressing  it  in  terms  common  with 
all  the  other  sources. 

The  purpose  of  this  investigation  is  to  explore  the  process  of  using  error  mod¬ 
eling  to  rigorously  predict  uncertainty  in  the  retrieved  reflectance,  expressed  as  an 
error  model.  Additionally,  this  process  will  be  used  to  determine  what  types  of  an¬ 
cillary  data  would  be  most  effective  in  improving  radiometric  inversion,  quantify 
the  expected  benefit  of  collecting  ancillary  data,  and  prescribe  optimal  methods  for 
the  use  of  ancillary  data  to  enhance  multi-  and  hyperspectral  reflectance  extraction. 
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The  scope  and  detailed  objectives  of  this  work  are  presented  in  chapter  2.  Inversion 
methods  and  ground  truth  usage  will  be  examined  in  chapter  3  to  provide  a  basic 
foundation  of  work  already  performed  in  this  area. 

A  method  is  presented  in  chapter  4  that  uses  basic  error  propagation  theory 
to  isolate  the  relative  magnitudes  of  various  error  sources  present  in  common  at¬ 
mospheric  inversion  algorithms  and  determine  in  what  ways,  if  any,  operational 
ground  truth  measurement  systems  can  be  employed  to  reduce  the  overall  error  in 
retrieved  reflectance  factor.  Several  types  of  common  ground  truth  measurements 
are  examined,  including  calibration  panel  reflectance  factor,  radiometric  quanti¬ 
ties  that  can  be  directly  measured  such  as  downwelled  radiance,  and  atmospheric 
parameters  such  as  water  vapor  content.  The  end  result  of  this  process  is  a  config¬ 
urable  error  propagation  model  in  which  each  type  of  measurement  is  cast  into  a 
common  uncertainty  framework.  The  error  model  is  built  to  accept  uncertainty  in¬ 
puts  from  a  variety  of  sources  and  features  a  pluggable  architecture,  where  specific 
instrument  noise  models,  inversion  techniques,  and  sensing  scenarios  can  be  added 
or  changed  to  tailor  the  model’s  predictions. 

The  model  is  exercised  for  a  family  of  example  scenarios,  the  results  of  which 
are  presented  in  chapter  5.  A  combination  of  error  sources  are  used  to  create  the 
model’s  components,  including  published  noise  models  for  several  imaging  spec¬ 
trometers,  commercially  available  weather  sensing  instruments,  historical  climate 
data  for  the  region  and  time-of-year  used,  and  typical  inversion  algorithm  perfor¬ 
mance  in  determining  the  various  atmospheric  variables  required.  These  serve  as 
default  values  to  two  ends.  First,  they  are  placeholders  for  actual  parameters  that 
may  be  used  to  predict  uncertainty  performance  in  applications  of  future  interest. 
More  importantly,  this  scenario’s  results  are  also  used  to  expose  the  inner  work¬ 
ings  of  a  non-linear  system.  The  results  provide  insight  into  how  each  part  of  the 
imaging  chain  affects  the  final  outputs,  and  because  the  inputs  are  representative 
of  current  remote  sensing  practices,  these  results  will  be  relevant  to  the  family  of 
scenarios  standard  within  the  community  today. 

While  this  space  is  frequently  investigated,  normally  changes  in  the  reflectance 
spectra  are  compared  as  a  function  of  changes  to  the  inversion  process  or  inputs. 
This  dissertation  takes  a  different  approach,  conducting  the  entire  analysis  in  er¬ 
ror  space  instead  of  reflectance  space.  Error  space  reflectance,  while  expressed 
in  the  same  units  as  actual  retrieved  reflectance,  is  a  non-literal  quantity  that  does 
not  attempt  to  predict  the  absolute  value  of  a  retrieved  spectrum,  rather,  it  predicts 
the  amount  of  uncertainty  present  in  each  retrieved  band.  Casting  results  in  er¬ 
ror  space  allows  the  use  of  a  statistical  language  to  describe  the  aforementioned 
changes  in  reflectance  spectra  observed  elsewhere.  The  use  of  retrieved  reflectance 
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offers  a  non-intuitive  metric,  useful  only  when  compared  to  a  reference  spectrum. 
In  contrast,  terms  expressed  in  error  space  provide  an  immediate  insight  into  the 
processes  at  work. 


Chapter  2 

Objectives 


The  main  objective  of  this  research  is  to  determine  a  method  for  optimally  reduc¬ 
ing  the  error  in  retrieved  reflectance  factors  through  the  use  of  ancillary  data  (of 
which  ground  truth  is  a  subset).  It  closely  matches  the  goals  of  NASA’s  Integrated 
Sensing  Systems  Initiative  (ISSI)  program,  which  seeks  to  enhance  remote  sensing 
products  through  ground-truth  augmentation.  This  primary  goal  will  be  attained  by 
completing  the  major  and  minor  objectives  listed  below.  Completion  of  the  major 
objectives  is  required  to  sufficiently  investigate  the  hypothesis.  The  completion  of 
the  minor  objectives  adds  value  to  the  overall  degree  of  comprehensiveness  of  the 
work,  but  it  is  not  absolutely  required  that  these  be  completed.  Thus,  the  minor 
objectives  will  be  accomplished  pending  completion  of  the  main  objectives  and  in 
the  context  of  the  available  time  and  resources.  A  list  of  success  criteria  is  provided 
by  which  work  towards  meeting  the  major  objectives  can  be  measured.  Finally,  the 
scope  of  the  work  is  listed.  Defining  a  scope  makes  it  clear  what  areas  of  inquiry 
will  not  be  answered  by  this  proposed  research. 

2.1  Main  Objectives 

Top  level  goal:  Prescribe  an  optimal  ancillary  data  measurement  framework,  in¬ 
cluding  type  and  number  of  ancillary  data  measurement  devices.  Optimal  is  defined 
in  relation  to  the  precision  of  retrieved  reflectance  and  accounts  for  the  amount  of 
precision  gain,  network  cost,  and  instrument  complexity. 

1 .  Characterize  the  forward  error  chain 

•  Review  or  establish  the  processes  by  which  error  is  introduced  to  the 
forward  remote  sensing  chain 
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•  Determine  the  amount  of  inherent  uneertainty  in  eaeh  proeess,  speeifi- 
eally  with  regards  to  the  use  of  available  a  priori  aneillary  data 

•  Create  a  statistieal  model  for  eaeh  error-introdueing  proeess  for  eaeh 
element  in  the  forward  remote  sensing  ehain 

•  Determine  the  sensitivity  of  the  at-sensor  radianee  to  ineremental  ehanges 
in  eaeh  physieal-world  atmospherie  input  parameter 

•  Determine  the  sensitivity  of  the  at-sensor  radianee  to  ineremental  ehanges 
in  the  following  non-atmospherie  input  parameters:  sky  fraetion;  eloud 
fraetion;  speetral  band  widths,  bias,  and  eenters;  look  geometry;  and 
ground  target  tilt 

2.  Charaeterize  the  reverse  uneertainty  ehain 

•  Perform  an  uneertainty  analysis  of  several  major  inversion  algorithms 

•  Determine  the  sensitivity  of  the  retrieved  speetral  refleetanee  to  inere¬ 
mental  reduetions  of  uneertainty  in  eaeh  parameter  eonsidered  by  eaeh 
inversion  algorithm 

•  Prediet  for  eaeh  inversion  algorithm  what  quantity  should  be  measured 
for  the  greatest  reduetion  of  uneertainty  of  retrieved  speetral  refleetanee 

•  Compare  instrument-indueed  errors  to  algorithm-indueed  errors  (due 
to  uneertainty  in  atmospherie  parameters  or  inherent  assumptions) 

3.  Analyze  the  seene-wide  effeetiveness  of  different  types  of  uneertainty -reduetion 
sehemes 

•  Determine  how  aneillary  data  measurements  improve  retrieved  speetral 
refleetanee  as  a  funetion  of  measurement  type,  preeision,  and  frequeney 

4.  Validate  these  predietions  with  experimental  data 

•  Design  and  eonduet  an  experiment  using  synthetie  image  modeling 

•  Design  and  eonduet  an  experiment  using  real-world  aerial  and/or  satel¬ 
lite  imagery  and  simultaneous  aneillary  data  measurements 


2.2  Minor  Objectives 


Demonstrate  the  usefulness  of  improved  speetral  refleetanee  faetor  preeision 
and  aeeuraey  in  deriving  remote  sensing  produets 
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•  Connect  the  reduction  of  error  in  retrieved  spectral  reflectance  to  improve¬ 
ments  in  common  remote  sensing  applications 

•  Consider  the  effects  of  errors  inherent  in  MODTRAN  on  the  sensitivity  anal¬ 
ysis 


2.3  Scope 

Limiting  the  scope  of  the  investigation  serves  to  focus  the  work  towards  a  specific 
and  definable  hypothesis.  Expanding  the  limits  of  the  scope  is  a  subject  for  any 
future  work. 

•  The  wavelength  range  is  limited  to  the  non-thermally  emissive  portion  of  the 

electromagnetic  spectrum,  VIS/NIR/SWIR  (0.4  -  2.5  //m).  A  wide  vari¬ 

ety  of  instruments  is  used  in  this  research,  and  many  have  a  limited  spectral 
range.  Thus,  practicality  further  limits  this  spectral  range  to  just  the  VIS/NIR 
ranges  (approx  0.4  /rm  -1.1  /rm)  in  the  context  of  experimental  validation 
of  predictions. 

•  Whereas  a  near-infinite  set  of  atmospheric  parameters  is  available  for  study, 
a  limited  set  of  atmospheric  parameters  is  studied.  Parameter  selection  was 
decided  from  preliminary  literary  research  and  investigation  and  designed  to 
have  the  broadest  impact  and  predictive  value  possible 

•  The  atmospheric  constituents  studied-water  vapor,  aerosols,  and  well -mixed 
gas  molecules-are  assumed  to  behave  as  statistically  independent  random 
variables,  which  allows  an  assumption  that  the  parameters  are  also  uncorre¬ 
lated. 


-  The  caveat  only  applies  to  correlations  between  the  atmospheric  con¬ 
stituents  themselves,  not  radiometric  observables  (radiance  and  trans¬ 
mittance).  It  is  noted  that  functions  of  the  constituents  are  known  to 
be  highly  correlated  to  one  another  in  practice,  and  the  analysis  results 
used  in  the  governing  equations  constructed  for  the  model  bear  this  out. 

-  The  mathematical  apparatus  to  accommodate  non-independence  of  these 
input  parameters  is  fully  developed  and  made  available  for  use  in  the 
error  propagation  model. 

-  Determining  the  degree  of  independence  and  correlation  between  at¬ 
mospheric  constituents  is  a  study  in  meteorology  left  beyond  the  scope 
of  this  investigation. 
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•  No  temporal  variation  in  atmospheric  conditions  is  analyzed.  This  is  to  say 
that  the  atmosphere  is  assumed  to  be  the  same  during  image  collection  as  it 
is  during  ground  truth  collection  unless  explicitly  stated. 

•  Sensor  noise  is  assumed  to  be  a  stationary  random  variable.  No  temporal 
variation  (calibration  drift)  in  instrument  capabilities  is  studied.  As  a  prac¬ 
tical  matter,  sensitivity  of  the  results  to  sensor  drift  could  be  a  significant 
concern  and  requires  further  investigation. 

•  To  improve  the  tractability  of  an  analysis  of  this  type,  a  truncated  set  of  in¬ 
version  algorithms  is  studied.  The  algorithms  studied  are  the  empirical  line 
method  (ELM)  and  the  fast  line-of-sight  atmospheric  analysis  of  spectral  hy¬ 
percubes  algorithm  (FLAASH),  and  are  taken  to  be  representative  members 
of  a  family  of  inversion  algorithms.  This  assumption  allows  results  from 
similar  algorithms  (like  ATREM)  to  be  used  without  a  loss  in  validity  in  the 
conclusions  made. 

•  The  model-based  inversion  algorithms  are  treated  as  “black  boxes”  in  that 
their  inner  workings  are  beyond  the  scope.  Inputs,  outputs,  and  reported  er¬ 
ror  results  are  accepted  at  face  value.  A  rigorous  treatment  of  the  internal 
mechanisms  responsible  for  FLAASH’s  results  and  errors  would  be  an  ex¬ 
tremely  interesting  but  ultimately  off-topic  direction  for  this  investigation  to 
take. 


2.4  Success  Criteria 

To  declare  this  research  a  success,  two  simple  criteria  must  be  met. 

•  With  regards  to  uncertainty  in  retrieved  reflectance,  the  antecedent  sources 
of  uncertainty  in  each  atmospheric  parameter  or  modeling  output  must  be 
clearly  traced,  quantified,  and  ranked  by  relative  magnitude,  spectrally  if 
necessary. 

•  An  optimal  strategy  for  using  information  about  error  source  strength,  if  one 
exists,  must  be  provided.  In  other  words,  an  answer  will  be  provided  to  the 
question,  “Do  1  purchase  a  field  reflectometer,  a  sun  photometer,  or  a  better 
instrument?” 

Sub-objectives  of  results  validation  and  a  description  of  value-added  to  remote 
sensing  activities  are  extremely  important,  but  they  support  these  two  fundamental 
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criteria.  It  may  also  be  the  case  that  an  optimal  strategy  does  not  exist,  and  if  this 
is  the  case  the  optimal  strategy  of  “don’t  waste  resources  collecting  ground  truth 
because...”  will  be  accepted.  A  bottom-line  goal  of  66%  reduction  in  reflectance 
uncertainty  is  set.  For  an  uncertainty  of  3-5  reflectance  units,  the  desired  result  is  a 
reduction  to  1-1.5  reflectance  units  or  better. 


Chapter  3 

Background 


Atmospheric  inversion  with  the  intent  of  obtaining  ground  reflectance  spectra  has 
long  been  a  staple  of  multi-  and  hyperspectral  image  processing.  The  spectral 
content  of  remote  sensing  products  allows  the  extension  of  lab  spectrographic  clas¬ 
sification  of  materials  to  the  world  at  large  with  the  added  value  of  high  spatial 
coverage  and  access.  What  differs  from  lab  spectroscopy,  however,  is  the  presence 
of  the  atmosphere;  molecules  in  the  atmosphere  scatter,  absorb,  and  emit  radiation 
that  obscure  the  true  spectral  signature  of  objects  on  the  ground.  During  the  past 
several  decades  many  approaches  have  been  devised  to  model,  compensate  for, 
predict,  or  circumvent  the  effect  of  the  atmosphere  on  photons  passing  through  it. 
The  historical  development  of  atmospheric  compensation  methods  will  provide  the 
context  in  which  this  research  is  meaningful. 

3.1  Radiative  transfer  model 

The  physics  based  model  used  to  describe  radiative  transfer  is  detailed  first.  Each 
model  accounts  for  the  sources  and  processes  operating  on  photons  as  they  tra¬ 
verse  the  atmosphere.  There  are  two  major  flavors  in  terms  of  terminology  used, 
but  each  one,  as  well  as  the  many  variants,  essentially  models  the  same  phenom¬ 
ena.  The  model  used  here  is  based  on  the  one  derived  by  Schott  (1997),  with  the 
other  common  terminology  convention  originating  with  the  FLAASH  crowd  (Berk 
et  ah,  2002).  The  model  will  be  described  briefly,  primarily  to  provide  a  common 
terminology  base  as  well  as  to  highlight  differences  from  the  literature  required  to 
accommodate  the  extended  modeling  framework  introduced  herein. 

There  is  a  great  deal  of  detail  that  can  go  into  a  radiative  transfer  model,  but  lim¬ 
iting  the  scope  of  the  effects  the  model  attempts  to  encompass  allows  a  formidable 
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task  -  the  accounting  for  every  photon  to  enter  a  sensor  -  to  be  reduced  into  a 
manageable  one.  Any  time  light  interacts  with  matter,  it  can  either  be  reflected, 
absorbed,  or  transmitted.  Light  that  reflects  off  the  ground  back  at  an  airborne  or 
spaceborne  sensor  subsequently  contains  the  material’s  unique  spectral  signature 
(color),  which  in  turn  is  the  sole  source  of  reflectance  signature  information  for  re¬ 
mote  sensing  applications.  Because  of  its  intended  usage,  the  model  is  focused  on 
target  reflectance.  Reflectance,  also  known  as  bidirectional  reflectance,  describes 
how  light  is  scattered  in  a  particular  direction  and  is  a  function  of  the  incoming 
radiation  angle  and  the  outgoing  radiation  angle  in  relation  to  some  material  refer¬ 
ence  angle.  Reflectance  factor,  r,  is  a  directionless  and  unit-less  quantity  that  gives 
the  ratio  of  radiation  reflected  in  a  direction  to  the  amount  of  radiation  that  would 
be  reflected  by  a  Lambertian  (perfectly  diffuse)  material  illuminated  in  a  similar 
fashion.  Light  reaching  a  sensor,  then,  contains  both  photons  encoded  with  the  re¬ 
flectance  information  of  interest  and  photons  that  do  not  contain  this  information. 
Separation  of  photons  into  target-reflected  and  non-target-reflected  groups  allows 
a  conceptually  simple  universal  radiance  model  as  the  starting  point,  equation  3.1. 
The  terms  are  divided  into  these  two  categories  and  replaced  with  two  coefficients: 
Cl  and  C2. 


LsR  =  cir  +  C2  (3.1) 

Radiance  terms  will  continue  to  appear  with  various  subscripts;  these  will  al¬ 
ways  be  denoted  by  L.  The  sensor  output  is  an  integer  number  of  digital  counts, 
which  is  will  always  be  denoted  by  DC.  All  terms  are  implicitly  spectral  where 
appropriate,  including  irradiance,  radiance,  digital  counts,  reflectance,  and  trans¬ 
mittance.  Recasting  the  expression  in  terms  of  sensor  output,  and  assuming  a  linear 
relationship  between  incident  radiance  and  output  digital  counts  gives  a  fundamen¬ 
tally  identical  expression,  although  the  coefficients  have  been  marked  with  primes 
to  indicate  a  difference  with  those  in  equation  3.1  (the  application  of  the  linear 
radiance-to-counts  calibration).  This  expression  is  equation  3.2. 

DC  =  c'^r  -|-  C2  (3-2) 

The  simplified  coefficients  will  now  be  expanded  to  reflect  the  physics-based 
model  commonly  developed  elsewhere  (Schott,  1997).  The  basic  radiative  transfer 
expression,  in  which  sensor  reaching  radiance  Lsr  is  described  in  terms  of  the 
applicable  atmospheric,  geometrical,  and  material  parameters  involved,  is  given  as 
equation  3.3: 
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Lsr 

For  the  sake  of  future 
3.4  to  isolate  refleetanee. 


=  cos  OgiTi  +  T2r  +  Lu  (3.3) 

referenee,  these  terms  are  easily  rearranged  in  equation 


r  =  (3.4) 

(^-^coscJs'ri  +  Ldj  T2 

Eleetromagnetie  radiation  from  the  sun  is  expressed  as  exoatmospherie  solar 
irradianee,  a  measure  of  the  power  of  ineident  photons  per  unit  area.  It  is  assumed 
to  be  eonstant  leaving  the  sun  and  varies  seasonally  due  to  ehanges  in  the  earth- 
sun  distanee.  This  term  is  denoted  as  Eg.  The  water  vapor,  well-mixed  gases, 
and  suspended  partieles  in  the  atmosphere  seatter  and  absorb  the  light  as  it  travels 
from  the  top  of  the  atmosphere  to  the  ground.  The  ratio  of  light  that  makes  it  to  the 
ground  without  interaeting  with  atmospherie  moleeules  to  the  total  light  ineident  on 
the  atmosphere  is  known  as  the  atmospherie  transmittanee  of  the  downward  path  or 
solar  path  transmissivity.  It  will  be  denoted  as  ri.  Just  as  light  passing  through  the 
atmosphere  ean  be  seattered  out  of  the  downward  path,  light  is  also  seattered  from 
all  points  in  the  atmospherie  dome  down  to  the  ground.  This  irradianee  is  known  as 
sky  light  or  downwelled  irradianee  and  is  refleeted  off  the  ground  aeeording  to  its 
surfaee  properties.  If  the  refleetor  is  perfeetly  diffuse,  the  irradianee  is  eonverted 
to  radianee  by  dividing  by  tt. 

There  are  other  sourees  of  radiation  illuminating  the  ground.  Two  major  sourees 
are  baekground  objeets  and  elouds.  These  ean  be  thought  of  as  fixed  in  the  sky 
dome  in  unknown  loeations  and  proportions  and  either  reduee  or  inerease  the 
amount  of  radianee  depending  on  their  speeifie  albedos.  Either  type  of  objeet  ean 
be  brighter,  darker,  or  a  different  eolor  relative  to  the  sky  radianee  it  supplants. 
A  final  souree  is  self-emitted  thermal  photons,  whieh  are  negligible  in  the  visi¬ 
ble  part  of  the  speetrum.  In  aggregate,  radianee  eoming  from  the  sky,  elouds,  and 
baekground  objeets  are  known  as  downwelled  radianee.  La- 

Another  faetor  that  affeets  how  the  radiation  is  refleeted  is  the  relative  orien¬ 
tation  of  the  surfaee  to  the  earth’s  loeal  horizontal  plane.  Due  to  projeeted  area 
effeets,  the  zenith  angle  to  the  sun  will  reduee  the  amount  of  direet  solar  irradianee 
hitting  the  ground;  the  angle  ag'  is  the  zenith  angle  eorreeted  for  any  deviation 
between  the  target’s  normal  plane  and  the  earth’s  loeal  horizontal  plane. 

Eight  on  its  way  from  the  ground  to  the  sensor  eneounters  the  same  seattering 
and  absorption  effeets  that  it  did  on  the  way  down.  The  ratio  of  light  passing 
through  the  atmosphere  to  total  light  leaving  the  ground  is  denoted  as  T2  and  is 
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a  transmittance  factor  just  like  ri,  except  it  is  for  the  ground-to- sensor  path.  The 
final  term  in  the  equation,  Lu,  is  known  as  upwelled  radiance  and  accounts  for  the 
addition  of  light  that  was  never  reflected  off  the  target  ground  spot. 

The  upwelled  and  downwelled  radiance  terms  will  be  expanded  into  constituents. 
In  strict  usage,  upwelled  radiance  technically  refers  to  photons  scattered  in  the  at¬ 
mosphere  up  towards  the  sensor.  It  was  forced  to  collect  all  categories  of  light  that 
enter  the  sensor’s  field  of  view  without  first  reflecting  off  the  target  (instead  reflect¬ 
ing  off  non-target  ground  objects  one  or  more  times  and  scattered  into  the  sensor’s 
field  of  view)  because  it  is  sometimes  convenient  to  collect  these  two  terms  into 
a  single  variable  as  was  originally  done  in  equation  3.3  so  as  to  resemble  equa¬ 
tion  3.1.  All  photons  covered  by  the  term  are  functionally  identical:  they  do  not 
contain  the  target  spectral  signature.  However,  from  a  modeling  standpoint  it  is 
necessary  to  account  for  the  various  types  of  photons  separately.  A  second  term, 
Ladj,  is  added  to  account  for  these  adjacent  non-target  ground  object  photons  and 
the  original  term,  is  recast  into  its  strict  definition. 

Likewise,  the  downwelled  radiance  term  is  a  collection  of  several  very  im¬ 
portant  terms.  Functionally  the  sub-terms  all  share  the  character  of  indirect  solar 
radiation  that  has  reflected  off  the  target  into  the  sensor’s  view.  However,  there  are 
three  diverse  sources  contributing  to  this.  The  first  is  the  strictly  downwelled  solar 
radiance,  which  is  scattered  by  the  atmosphere  directly  onto  the  target.  The  sec¬ 
ond  is  radiance  reflected  off  of  terrestrial  background  objects,  and  third  is  radiance 
coming  from  clouds.  These  three  sources  of  radiance  are  shown  in  figure  3.1. 


(a)  three-dimensional  view 


(b)  two-dimensional  view 


Figure  3.1:  Indirect  radiance  sources 


In  figure  3.1,  background  radiance  geometry  is  modeled  as  a  terrain  mask  an- 
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gle,  which  is  a  compromise  between  the  rigorous  modeling  of  terrain  features  advo¬ 
cated  elsewhere  and  the  traditional  custom  of  ignoring  background  radiance  com¬ 
pletely.  Everything  below  the  mask  angle  is  assumed  to  be  background  radiance 
and  everything  above  it  is  sky  and  cloud.  Background  radiance  and  cloud  radi¬ 
ance  are  equally  volatile  sources:  it  is  not  possible  to  mathematically  predict  their 
effects  because  their  antecedent  sources  -  human  activity,  weather  patterns,  ter¬ 
rain,  and  vegetation  -  are  unpredictable  without  prior  knowledge  of  the  area  and/or 
time  history.  Rigorously  modeling  both  the  terrain  features  and  their  contributions 
to  the  radiance  incident  on  a  target  is  a  task  for  physics-based  scene  generation 
algorithms.  The  use  of  such  algorithms  may  well  be  necessary  for  the  accurate 
computation  of  the  background  radiance,  but  for  the  purposes  of  this  investigation 
it  is  not  absolutely  required. 

In  a  slight  departure  from  other  treatments,  diffuse  radiance  is  modeled  with 
a  three-part  mixing  model  and  two  sky  fraction  coefficients  rather  than  a  two-part 
mixing  model  and  a  single  sky  fraction  coefficient.  The  fraction  Fi  is  used  to  rep¬ 
resent  all  clear  sky  unobstructed  by  clouds  or  background  objects  or  terrain.  The 
other  coefficient,  F2,  accounts  for  all  sky  not  masked  by  background  objects  or  ter¬ 
rain.  The  difference  between  Fi  and  F2  represents  the  portion  of  the  sky  occupied 
by  clouds.  Both  terms  are  depicted  visually  in  figure  3.2.  These  addifions  resulf  in 
a  slighfly  longer  form  of  equafion  3.3,  which  has  been  rewriffen  as  equation  3.5. 
This  is  fhe  form  fhaf  will  be  analyzed  using  fhe  error  propagafion  techniques  fo  be 
ouflined  in  chapfer  4. 

Es 

- cos  (JsiTlT2r 

TT 

{F2  {FiLd  -I-  (1  —  Fi)  Lcid)  +  (1  —  F2)  Lbkg)  T2r 

Eu  T  Eadj  (3.5) 

3.2  Inversion  algorithm  descriptions 

Several  handfuls  of  mefhods  exisf  fo  inverf  equafion  3.5  and  isolate  fhe  reflecfance 
ferm.  The  main  difficulfy  is  obfaining  accurafe  values  for  each  of  fhe  componenf 
ferms,  allhough  a  subsel  of  fhe  problem  is  fo  jusl  separale  fhe  terms  wilh  a  mulli- 
plicalive  relationship  fo  reflecfance  from  Ihose  wilh  an  addilive  relalionship. 

Wilh  respecl  fo  mulli-  or  hyperspeclral  imagery  in  fhe  visible  speclral  region, 
inversion  algorilhms  can  be  divided  info  several  roughly-defined  groups.  One  fam¬ 
ily  of  algorilhms  aggregales  equation  ferms  info  mulliplicalive  or  additive  faclors  in 
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order  to  isolate  refleetanee.  There  are  several  diverse  strategies  for  estimating  one 
or  both  of  these  faetors  without  needing  to  determine  eaeh  eomponent  term,  but 
these  algorithms  are  united  in  their  disinterest  in  the  individual  terms  of  equation 
3.5.  As  the  empirieal  line  method  is  today  the  flagship  algorithm  for  this  group,  and 
beeause  observation,  measurement,  or  experienee  enable  their  underlying  assump¬ 
tions,  perhaps  it  would  be  appropriate  to  refer  to  these  as  empirieal  algorithms. 

The  other  family  of  algorithms,  in  eontrast,  uses  atmospherie  modeling  with 
the  admirable  yet  diffieult  goal  of  approximating  the  absolute  value  of  eaeh  of  the 
eomponent  terms  of  the  radiative  transfer  equation  3.5.  A  physies-based  model  is 
seeded  with  the  appropriate  eonditions,  and  by  simulating  atmospherie  seattering 
and  absorption  effeets,  the  algorithm  estimates,  via  a  pre -built  lookup  table,  the 
eorreet  mix  of  atmospherie  eonstituents  using  various  eues  available  in  the  pixel 
speetra.  The  radiative  transfer  eomponents  are  then  determined  by  the  software, 
isolating  pixel  refleetanee  speetra  as  the  algorithm  output.  These  model-based  al¬ 
gorithms  use  eomputer  eode  that  simulates  the  atmosphere’s  seattering  and  absorp¬ 
tion  through  numerieal  integration  of  the  applieable  governing  equations.  Two  sueh 
atmospherie  modeling  programs  are  MODTRAN  (Berk  et  ah,  1989)  and  6S  (the 
Seeond  Simulation  of  the  Satellite  Signal  in  the  Solar  Speetrum)  (Vermote  et  ah. 
May  1997).  MODTRAN  4  (Berk  et  ah,  1999)  was  used  in  this  work. 

The  primary  benefit  of  the  modeling  approaeh  is  that  it  ean  be  done  using  solely 
in-seene  speetral  radianee  data  with  no  external  ground  truth  information.  An- 
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other  significant  benefit  is  the  possibility  of  an  individual  solution  for  each  pixel 
as  opposed  to  a  single  scene-wide  transformation  whose  validity  is  known  only  at 
the  point  in  the  scene  at  which  ground  truth  was  taken  and  is  in  question  every¬ 
where  else.  Drawbacks  to  model-based  algorithms  are  their  complexity  and  re¬ 
liance  on  assumptions  inherent  both  in  the  algorithm  and  the  simulation  software. 
This  makes  their  results  sensitive  to  inaccuracies  in  underlying  models  or  failure  to 
account  for  differences  between  real-world  conditions  and  those  assumed.  Because 
these  differences  are  rarely  catastrophic,  model-based  algorithms  tend  to  produce 
acceptable  output,  although  there  are  regimes  in  which  model-based  algorithms 
are  thought  to  be  weak  (for  example,  humid  environments),  as  well  as  instances 
of  when  various  models  fail  to  agree  with  each  other.  After  reviewing  the  basic 
methods,  a  quick  survey  of  results  will  attempt  to  bound  the  performance  of  these 
algorithms,  to  include  the  anomalies  mentioned. 


3.2.1  Empirical  algorithm:  the  Empirical  Line  Method 

The  empirical  line  method  (ELM)  is  one  of  the  simplest  and  most  time-worn  atmo¬ 
spheric  inversion  algorithm  in  the  imaging  scientist’s  toolbox.  Its  persistence  is  an 
indicator  of  its  usefulness,  which  is  due  to  the  fact  that  it  takes  advantage  of  uncal¬ 
ibrated  radiance,  requires  a  minimum  of  external  information,  is  mathematically 
simple,  and  generally  produces  decent  results. 

Smith  and  Milton  (1999)  provide  a  brief  overview  of  the  method  in  the  con¬ 
text  of  their  larger  discussion  of  calibration  target  selection.  The  atmosphere  is 
assumed  to  be  a  linear  operator  with  respect  to  ground-leaving  radiance,  following 
the  form  in  equation  3.2.  Although  equation  3.3  shows  there  is  much  complex¬ 
ity  in  predicting  the  equations  constants  from  a  bottom-up  approach,  the  empirical 
line  method  by-passes  it,  instead  focusing  on  the  single  reflectance  term.  If  two 
or  more  radiance  spectra  are  collected  on  known-reflectance  targets,  a  linear  plot 
similar  to  that  shown  in  figure  3.3  can  be  constructed.  Ostensibly,  one  is  done  at 
this  point,  having  determined  the  slope  and  intercept,  which  are  equivalent  to  the 
terms  and  C2  from  equation  3.2.  Any  digital  count  in  the  image  can  be  converted 
to  reflectance  simply  applying  d^  and  C2  to  equation  3.6. 


DC  -  4 
c'l 


(3.6) 


The  need  to  apply  prudent  precautions  when  using  this  method  in  the  field  is 
often  mentioned.  The  primary  consideration  is  the  error  in  ground  truth  reflectance 
measurements  can  create  significant  error.  To  mitigate  the  sensitivity  of  the  results 
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Reflectance  (r) 


Figure  3.3:  The  linear  relationship  of  the  empirieal  line  method 


to  measurement  error,  the  refleetanee  targets  used  to  ealibrate  the  model  must  en- 
eompass  the  widest  possible  dynamie  range.  Seeond,  a  high  number  of  refleetanee 
targets  is  preferable  so  that  a  linear  regression  solution  may  be  used  to  reduee 
the  overall  impaet  of  sensor  noise.  Smith  and  Milton  (1999)  and  Karpouzli  and 
Malthus  (2003)  both  take  these  steps,  with  the  former  demonstrating  the  disastrous 
effeets  of  using  refleetanee  targets  elosely  grouped  in  brightness.  A  notional  illus¬ 
tration  of  this  effeet  is  shown  in  figure  3.4,  in  whieh  ground  measurement  error  is 
added  as  horizontal  bars.  The  boundaries  indieate  the  limit  of  erroneous  refleetanee 
retrievals  based  on  the  ground  truth  error.  When  the  targets  are  eloser  together,  the 
larger  error  region  shows  the  potential  extrapolation  error  grows  eonsiderably. 

The  benefits  of  using  multiple  ealibration  targets  are  shown  in  figure  3.5.  The 
least-squares  solution  drives  down  error  to  its  minimum  point,  after  whieh  further 
improvement  is  possible  only  by  adding  mueh  more  data  or  by  redueing  error  in 
the  ground  truth  measurement.  Besides  target  spread  and  use  of  many  targets,  two 
other  major  eonsiderations  are  frequently  diseussed.  First  is  atmospherie  variabil¬ 
ity  aeross  the  image.  This  is  important  beeause  the  model  eonstants  refleet  aetual 
atmospherie  eonditions,  and  they  are  only  valid  if  the  atmosphere  they  deseribe 
aetually  exists  in  the  line  of  sight  to  eaeh  pixel.  Most  literature  elaims  the  small 
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(a)  Wide  reflectance  separation 


(b)  Narrow  reflectance  separation 


Figure  3.4:  ELM  error  exaeerbated  by  poor  eal  target  seleetion 


image  swath  justifies  ignoring  this  problem  as  a  souree  of  error,  but  this  intuitive 
judgment  is  not  supported  with  data.  The  seeond  eonsideration  is  related  to  the 
first.  Whereas  spatial  atmospherie  variation  is  beyond  eontrol  (and  usually  beyond 
measurement),  temporal  variation  is  earefully  avoided.  Cloud  eover  and  its  effeet 
on  illumination  is  the  primary  eause  of  temporal  variation  in  atmospherie  eondi- 
tions.  Again,  a  qualitative  judgment  is  usually  the  teehnique  employed  to  ignore 
the  impaet  of  this  effeet.  The  problem  is  that  even  when  elouds  are  not  visible  to 
the  human  eye,  illumination  is  ehanging  in  ways  pereeptible  by  the  ground  truth 
instrument,  over  time  periods  as  low  as  30-60  seeonds  (Smith,  2004).  It  is  im¬ 
portant  to  understand  these  sourees  of  error  in  the  empirieal  line  method  beeause 
the  method  is  so  eommonly  used  and  is  eonsidered  reliable  in  a  wide  variety  of 
situations. 


Companion  algorithms  to  the  empirieal  line  method  employ  similar  approaehes 
without  requiring  supplemental  ground  truth  measurements.  Different  teehniques 
exist  to  determine  one  or  both  of  the  required  eoeffieients  for  performing  the  linear 
inversion  method  deseribed  above. 
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(b)  IKONOS  ELM  results  (Karpouzli  and  Malthus,  2003) 


Figure  3.5:  ELM  results  improved  by  linear  regression  from  multiple  targets 
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3.2.2  Model-based  algorithm:  Green’s  method 

Robert  Green  deseribed  a  method  of  estimating  atmospherie  parameters  from  in- 
seene  speetra  to  aid  in  the  proeessing  of  AVIRIS  data.  AVIRIS  is  the  Airborne 
Visible/Infrared  Imaging  Speetrometer,  a  hyperspeetral  VNIR  instrument  built  by 
NASA  (Vane,  1987).  Aerosol  optieal  depth,  atmospherie  water  vapor,  and  surfaee 
pressure  were  the  parameters  seleeted  to  fully  aeeount  for  the  seattering  and  ab¬ 
sorbing  speeies  in  the  spaee  between  souree,  target,  and  sensor.  This  parameter 
seleetion  is  seminal  with  respeet  to  derivative  algorithms  as  well  as  the  model¬ 
ing  presented  in  this  work,  whieh  have  adopted  them  as  the  standard  variables  for 
spanning  the  atmospherie  variability  spaee  (Green  et  al.,  1993).  Variations  on  these 
parameters  are  possible,  for  example,  using  horizontal  visibility  as  a  proxy  parame¬ 
ter  for  optieal  depth  or  moleeular  number  density  instead  of  a  seale  height.  Green’s 
parameters  possess  advantages  for  the  modeling  proeess  deseribed  in  this  work,  so 
they  will  be  used  here,  albeit  with  a  minor  modifieation  deseribed  later  on. 

Under  some  eonditions,  aerosol  optieal  depth  ean  be  a  primary  driver  for  the 
amount  of  baekseattered  radianee  reaehing  the  sensor,  dominant  over  other  eon- 
stituents  in  the  visible  blue-green  region.  Optieal  depth  refers  to  an  extinetion  ex¬ 
ponent  that  models  transmission  deeay  of  light  through  a  non-vaeuum  medium.  In 
equation  3.7,  the  optieal  depth  da  is  shown  to  be  related  to  an  absorption  eoeffieient 
(5a  and  the  distanee  into  the  medium  over  whieh  absorption  takes  plaee,  x.  A  pro¬ 
eess  deseribed  as  non-linear  least  square  speetral  fitting  (NLLSSF)  was  iteratively 
used  to  determine  what  optieal  depth  setting  at  500  nm  produees  the  elosest  mateh 
with  the  observed  AVIRIS  speetra  over  the  visible  region  between  400-600  nm. 
The  use  of  a  pre-generated  lookup  table  allows  the  algorithm  to  effieiently  seareh 
through  a  series  of  optieal  depths  until  the  best  parameter  fit  is  obtained.  The  fit 
method  was  found  to  aehieve  results  eomparable  with  other  methods,  sueh  as  the 
Regression  Interseetion  Method  for  Aerosol  Correetion  (Crippen,  1986;  Webber 
et  al.,  2001). 

Spatial  variability  in  the  parameters  was  a  key  finding  of  Green’s  inifial  resulfs 
wifh  fhis  mefhod.  Aerosol  opfieal  depfh  was  found  fo  vary  up  fo  200%  from  one 
edge  of  an  1 1  km  x  10  km  AVIRIS  seene  fo  fhe  ofher. 

T  =  (3.7) 

Green  used  an  oxygen  absorpfion  fealure  al  760  nm  fo  eslimale  fhe  amounl  of 
gas  in  fhe  air  eolumn.  The  gases  are  said  fo  be  well-mixed,  meaning  Iheir  ralios 
are  Irealed  as  globally  uniform.  Therefore,  fhe  quanlilies  of  all  ofher  gases  ean 
be  delermined  from  any  single  one,  and  by  using  a  NLLSSF  proeedure  similar  fo 
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the  one  used  for  aerosols,  an  optimal  value  for  surface  pressure  height  can  be  de¬ 
termined.  Surface  pressure  height  correlates  to  well-mixed  gas  because  the  model 
atmosphere  used  in  MODTRAN  follows  a  standard  profile  in  which  the  aggregate 
gas  column  decreases  with  increasing  altitude.  This  effect  is  shown  for  sample 
MODTRAN  spectra  in  figure  3.6. 


Figure  3.6:  760  nm  oxygen  feafure  variafion  wifh  sensor  alfifude 


The  rafios  of  feafure  shoulder  fo  feafure  boffom  are  0.37,  0.38,  0.40,  and  0.56 
for  alfifudes  of  0,  0.5,  1,  and  5  km  respectively.  If  was  found  fhaf  fhis  mefhod  pro¬ 
duced  values  more  or  less  mafching  fhe  terrain  fealures  of  fhe  image  used,  fhough 
if  is  nof  known  on  how  fine  a  scale  fhis  was  frue  or  if  differences  were  observed, 
which  would  suggesf  a  non-sfandard  day  during  fhe  collection  of  fhe  reference  im¬ 
age. 

Wafer  vapor  is  acknowledged  as  having  one  of  fhe  sfrongesf  effecfs  on  re- 
flecfance  specfra.  The  effecfs  are  confined  fo  fhe  numerous  absorpfion  bands,  buf 
fhe  bands  widen  as  gaseous  wafer  vapor  increases  fo  fhe  poinf  where  fhere  are  few 
regions  nof  affecfed  in  some  way.  To  defermine  column  wafer  vapor.  Green  uses 
anofher  band  refrieval  mefhod,  fhis  time  af  940  nm.  Figure  3.7  shows  how  fhe 
specfral  feafure  varies  wifh  increasing  wafer  vapor  confenf  in  fhe  absorpfion  col¬ 
umn.  Wafer  confenf  on  fhe  ground,  specifically  in  green  vegefafion,  can  disforf  fhe 
refrieval  resulfs  in  fhe  940  nm  feafure,  so  Green  adds  a  requiremenf  to  compen¬ 
sate  for  that  additional  absorption  using  a  sample  leaf  reflectance  spectrum  when 
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calculating  the  ratio.  Later  studies  also  found  that  surface  water  greatly  distorts 
water  vapor  retrieval  (Felde  et  ah,  2004).  It  is  noted  that  water  vapor  was  observed 
to  have  varied  as  much  as  20%  across  scenes,  although  results  certainly  exist  that 
exceed  that  amount  by  an  order  of  magnitude  or  more. 


775  825  875  925  975  1025  1075  1125  1175  1225 


wavelength  (nm) 


Figure  3.7:  Water  vapor  absorption  features  by  total  column  amount.  Figure  taken 
from  Felde  et  al.  (2004).  Legend  indicates  water  vapor  content  in  xlOOO  atm-cm. 
1  atm-cm  is  equivalent  to  approximately  8.04  x  10^  gmicm? . 


Green’s  final  inversion  equations,  shown  below  as  equations  3.8  and  3.9  (Green 
et  ah,  1993),  are  basically  identical  to  equations  3.3  and  3.4.  Lt  is  the  total  radiance, 
p  is  the  target  spectral  reflectance,  F  is  the  exoatmospheric  solar  irradiance,  T^iu  is 
the  combined  down/up  transmission,  and  Lp  is  the  path  radiance.  These  terms  are 
all  directly  available  from  a  MODTRAN  run  properly  configured  with  the  retrieved 
atmospheric  parameters. 


Lt  =  {F  *Tdu*  p)  /tt  +  Lp 

(3.8) 

p  =  {Lt-  Lp)  /  {F/tt*  Tdu) 

(3.9) 

Green  mentions  some  important  areas  for  further  investigation,  namely  sensor 
calibration,  field  measurements,  temporal  effects,  and  choice  of  aerosol  model  - 
presumably  to  account  for  the  shape  of  the  scattering  spectrum  as  described  by  the 


28 


CHAPTERS.  BACKGROUND 


angstrom  exponent  and  the  phase  function/particle  size  distribution.  Since  then, 
the  general  method  has  undergone  countless  refinements  and  examinations  for  its 
effectiveness  in  various  regimes,  looking  at  different  types  of  sensors,  humidity, 
and  implementations,  to  name  a  few.  This  method  is  described  because  it  most 
closely  matches  the  modeling  technique  used  in  this  investigation.  Other  inver¬ 
sion  methods  have  been  developed  in  parallel,  such  as  Gao  and  Goetz’  ATREM 
(Gao  et  ah,  1993),  Carrere  and  ConoTs  CIBR  technique  for  obtaining  constituents 
from  in-scene  band  ratios  (Carrere  and  Conel,  1993),  and  several  others  that  are 
variations  on  the  same  general  idea.  The  algorithm  has  been  improved  in  several 
ways,  for  example  adding  other  absorption  features  in  the  case  of  ATREM  and  its 
successor  HATCH  (Qu  et  ah,  2003)  and  the  modeling  of  adjacency  as  is  the  case 
with  EEAASH  (Berk  et  ah,  2002).  EEAASH  will  be  examined  in  a  bit  more  detail 
because  it  is  designed  to  be  more  of  an  operational  implementation  of  the  basic 
inversion  algorithm. 


3.2.3  Model-based  algorithm:  Fast  Line-of-Sight  Atmospheric  Anal¬ 
ysis  of  Spectral  Hypercubes  (FLAASH) 

Fast  Eine-of-Sight  Atmospheric  Analysis  of  Spectral  Hypercubes  (Berk  et  ah,  2002) 
is  one  of  a  handful  of  algorithms  and  variants  available  to  perform  model-based  in¬ 
version.  It  was  developed  by  AFRE  and  Spectral  Sciences  Inc.  specifically  to  take 
advantage  of  the  MODTRAN4  radiative  transfer  code.  The  approach  used  in  the 
algorithm  builds  on  methods  described  by  Gao  and  Goetz  (1990a),  Green  et  al. 
(1993),  and  several  others.  The  governing  equation  is  reproduced  here  as  equation 
3.10  (Cooley  et  ah,  2002).  It  follows  the  general  form  of  equation  3.1,  in  which 
radiance  is  assumed  to  be  linearly  related  to  reflectance,  but  the  specific  form  was 
derived  from  fhe  physical  fheory  underlying  fhe  6S  code  (Vermofe  el  ah,  1994),  in 
particular  fhe  melhod  by  which  multiple  scallering  evenls  are  modeled. 


L* 


,  Bpe 

1-peS^l-peS^  “ 


(3.10) 


In  equation  3.10,  L*  is  again  used  lo  denote  radiance.  The  terms  p  and  p^  are, 
respectively,  fhe  speclral  refleclance  of  fhe  pixel  in  queslion  and  an  averaged  spec- 
fral  refleclance  of  fhe  area  immedialely  surrounding  fhe  pixel  in  queslion.  S  is  fhe 
spherical  albedo  of  fhe  afmosphere,  effeclively  Irealing  fhe  dome  as  a  refleclor  for 
fhe  purpose  of  calculaling  mulfiple  scallering.  L*  is  upwelled  palh  radiance,  and 
coeflicienls  A  and  B  represenl  multiplicative  terms  seen  in  equation  3.3  oblained 
from  MODTRAN4.  Il  is  noted  lhal  Ihe  entire  “B”  side  of  Ihe  equation  accounls 
for  photons  direclly  locally  adjacenl  to  Ihe  largel  pixel  scallered  into  Ihe  sensor’s 
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field  of  view,  whereas  the  effeets  of  multiple  seattering  in  the  denominator  of  both 
sides  manifest  over  a  larger  general  area.  Thus,  the  pe  terms  in  the  numerator  and 
denominator  are  teehnieally  different  terms,  although  in  praetiee  the  differenee  is 
small. 

FLAASH  is  fed  the  same  basie  metadata  that  Green’s  method  would  need:  eol- 
leetion  geometry,  time,  loeation,  and  sensor  band  model  (FLAASH  has  built-in 
support  for  AVIRIS  and  HYDICE,  the  Hyperspeetral  Digital  Imagery  Colleetion 
Experiment  (Mitehell,  1995)).  The  eode  first  prepares  a  lookup  table  (EUT)  by 
varying  water  vapor  over  a  range  of  values.  As  with  the  previous  algorithm,  the 
band  ratio  between  the  shoulder  of  an  absorption  feature  and  the  bottom  of  the  fea¬ 
ture  is  used  to  index  the  water  vapor  amount.  EEAASH  also  aeeounts  for  ehanges 
to  the  absolute  radianee  value  of  the  feature. 

Onee  the  water  vapor  lookup  table  is  available,  EEAASH  ean  then  use  the  asso- 
eiated  MODTRAN  outputs  A,  B,  L*,  and  S  to  eonstruet  radianee  results  for  every 
retleetanee  unit  between  0  and  100  (or  between  0.0  and  1.0  in  0.01  inerements). 
This  new  EUT  is  re-gridded  so  that  the  algorithm  ean  index  it  aeeording  to  water 
vapor  band  ratio  and  radianee,  and  a  water  vapor  eolumn  value  is  retrieved. 

The  baseline  EEAASH  algorithm  retrieves  aerosols  using  a  general  seene-wide 
estimate  based  on  empirieal  work  by  the  MODIS  team  (Kaufman  et  ah,  1997).  The 
ratio  between  the  0.66  pm  and  2.1  pm  bands  is  expeeted  to  be  eonstant  over  dark 
vegetation.  This  observation  ean  be  exploited  to  baek  out  speetral  differenees  be¬ 
tween  the  two  bands  eaused  by  aerosols,  whieh  largely  affeet  visible  bands.  Surfaee 
pressure  altitude  is  also  retrieved. 

The  adjaeeney  eorreetion  is  implemented  by  performing  spatial  eonvolution 
with  a  deeaying  exponential  kernel  over  the  seene.  The  eorreetion  is  required  both 
for  the  final  retleetanee  ealeulation  as  well  as  the  aerosol  retrieval.  MODTRAN 
seleets  the  size  of  the  kernel  by  aeeounting  for  faetors  sueh  as  sensing  altitude  and 
presumed  settings  for  aerosol  seale  height  and  phase  funetion. 

A  eloud  mask  is  required.  Cloud  determination  relies  on  an  algorithms  de¬ 
veloped  by  the  MODIS  group  and  others,  whieh  deteets  both  opaque  elouds  and 
partially  transparent  eirrus  elouds.  Opaque  elouds  must  be  exeluded  from  the  spa¬ 
tially  averaged  retleetanee  eonvolution  operation  as  well  as  the  retleetanee  inver¬ 
sion.  Pixels  under  the  eloud  mask  are  replaeed  with  average  seene  radianee. 

EEAASH  performs  a  very  straightforward  implementation  of  the  generalized 
model-based  algorithm.  Input  parameters  are  determined  in  a  eomputationally  ef- 
fieient  manner,  and  the  MODTRAN  outputs  are  used  to  solve  equation  3.10. 

Eor  the  remainder  of  this  investigation,  EEAASH  is  essentially  treated  as  a 
blaek  box.  Parameter  determination  is  not  explieitly  studied.  However,  parame- 
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ter  determination  is  used  as  a  virtual  injeetion  point  -  one  ean  imagine  stopping 
FLAASH  onee  it  has  determined  the  water  vapor  eolumn,  for  example,  and  swap¬ 
ping  that  value  with  a  measured  value.  That  measurement  may  be  better  or  worse, 
but  the  point  is  that  the  relative  effeets  ean  be  studied.  It  is  not  eurrently  possible 
to  literally  swap  out  FLAASH’s  deeisions  with  different  values  midstream,  but  this 
thought  experiment  style  of  approaeh  enables  the  evaluation  of  the  value  of  ground 
truth  sensor  networks  in  a  standardized  environment.  In  instanees  when  FLAASH 
eannot  be  performed,  sueh  as  with  sensors  laeking  the  requisite  bands,  it  might 
even  be  possible  to  evaluate  the  trade  between  adding  a  network  of  ground  sensors 
or  adding  bands  to  the  remote  sensing  instrument. 


Chapter  4 

Approach  and  Theory 


4.1  Introduction 

During  the  course  of  introducing  a  radiometric  inversion  bias  correction  technique 
at  the  seventh  JPL  Airborne  Earth  Science  Workshop  in  1998,  Dr.  Joseph  Board- 
man  of  AIG  provided  the  perfect  framing  and  motivation  for  the  problem  at  hand. 
The  AVIRIS  instrument  was  designed  to  be  a  highly  precise  instrument,  subject  to 
continuous  improvement  over  time,  but  it  could  not  by  itself  rise  above  the  limita¬ 
tions  of  the  rest  of  the  imaging  chain  of  which  it  was  a  part.  This  became  apparent 
when  inversion  results  did  not  improve  along  with  improvements  to  AVIRIS’  cali¬ 
bration  accuracy,  noise  sources,  and  stability,  pointing  to  an  obvious  root  cause: 

The  reason  for  this  is  the  limited  accuracy  of  the  combined  chain  of  ab¬ 
solute  standards,  calibrations,  models  and  measurements  that  connect 
the  high  precision  raw  DN  to  the  final  output  of  relatively  low  accuracy 
apparent  surface  reflectance.  Sources  of  error  including:  errors  in  the 
NIST  standard  bulbs;  spectral  and  radiometric  calibration  uncertainty; 
in-flight  system  changes;  solar  irradiance  model  errors,  inaccuracy  in 
atmospheric  parameter  estimation;  and  radiative  transfer  code  errors 
combine  to  limit  the  accuracy  of  the  final  apparent  reflectance  data  to 
no  better  than  several  percent  (Boardman,  1998). 

“Boardman’s  lament”  concludes  in  apparent  vexation: 

Filtered  by  this  relatively  inaccurate  signal  processing  chain,  the  very 
high  precision  (1  part  in  thousands)  of  the  new  AVIRIS  data  is  under¬ 
utilized.  It  is  like  a  very  high  quality  rifle  in  the  hands  of  a  near-sighted 
marksman,  lots  of  precision  but  limited  accuracy  (Boardman,  1998). 
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The  basic  concern  of  one  who  attempts  to  retrieve  a  reflectance  spectrum  is  this: 
“How  close  to  truth  is  my  solution  and  why?”  As  countless  parameters  interact  in 
obtaining  any  radiometric  inversion,  uncertainty  is  generated,  accumulates,  and 
multiplies.  Understanding  the  “why”  part  of  the  question  requires  that  the  error 
in  the  final  result  be  picked  apart  and  traced  back  to  its  sources.  Understanding 
the  behavior  of  error  in  the  system  involves  thorough  knowledge  of  the  system 
itself  and  how  uncertainty  in  the  various  parts  of  the  chain  interact  to  produce  an 
error-laden  result. 

This  chapter  develops  a  method  for  accounting  for  the  primary  sources  of  error 
in  an  imaging  chain,  provides  baseline  models  for  each  source,  and  shows  how 
errors  can  be  propagated  through  a  non-linear  system  into  a  common  framework, 
namely  reflectance  units.  The  propagation  of  statistical  error  provides  a  statistical 
result,  the  main  value  of  which  is  to  show  the  relative  magnitudes  and  sensitivities 
of  each  source.  The  following  approach  is  developed  and  proposed  to  answer  the 
question,  “How  can  error  in  retrieved  reflectance  be  most  effectively  reduced,  and 
how  much  reduction  can  be  achieved?” 


4.2  Imaging  operators 

Imaging  is  the  act  by  which  the  three-dimensional  physical  world  is  somehow 
recorded  in  a  spatially-indexed  array  of  data.  In  the  context  of  this  research,  pho¬ 
tons  originate  from  a  source,  propagate  through  space,  are  operated  on  by  the 
physical  world,  and  cause  a  measurable  effect  in  a  detector  instrument,  namely 
the  creation  of  an  electric  charge.  The  electric  charge  is  then  operated  on  further 
by  the  instrument  until  it  is  stored  as  digital  data.  As  the  photon  is  operated  on  in 
a  predictable,  physics-based  manner,  the  real  world  is  given  a  representation  as  an 
image. 

The  act  of  imaging,  therefore,  is  a  transformation  operation,  such  as  that  shown 
in  general  form  in  equation  4. 1 .  The  function  g  is  the  spectral  vector  for  each  spatial 
point  x',  y'  in  the  image.  The  function  /  depends  on  the  three-dimensional  spatial 
position  of  an  object,  its  spectral  properties,  how  it  changes  over  time,  and  a  host  of 
other  physical  qualities  of  the  object  being  imaged.  The  operator,  O,  is  comprised 
of  several  sub-operations:  photon  propagation,  reflection,  scattering,  absorption, 
transduction  to  an  electrical  charge,  operation  on  the  charge,  and  quantization.  This 
chain  of  operators  is  depicted  conceptually  in  figure  4.1. 


9  y')  =0{f  (x,  y,  z,  .)} 


(4.1) 
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Figure  4.1:  Imaging  operator  bloek  diagram 


This  researeh  is  eoneerned  with  operator  inversion.  Remote  sensing  appliea- 
tions  aet  within  either  the  target  (i.e.  real-world)  domain  or  the  image  domain 
(and  some  ean  aet  in  both).  Even  refleetanee-type  applieations  sueh  as  band  ratio 
produets,  seene  equalization,  and  phenomenology  regression  ean  use  an  image- 
spaee  representation.  However,  determining  a  physieal  quantity  sueh  as  the  abso¬ 
lute  magnitude  of  an  objeet’s  refleetanee  faetor,  whieh  most  elosely  eorresponds  to 
the  notional  funetion  /  in  equation  4.1,  neeessarily  involves  working  exelusively  in 
target  spaee.  The  eoneeptual  relationship  between  the  two  spaees  is  depieted  in  fig¬ 
ure  4.2.  It  will  be  neeessary  to  fully  understand  both  the  transformation  operations 
(forward  direetion)  and  inversion  operations  (reverse  direetion)  to  eharaeterize  the 
uneertainty  present  in  eaeh  step. 


4.3  Forward  uncertainty  model  description 

Imaging  with  the  intention  of  obtaining  a  speetral  radianee  signature  for  the  objeets 
in  the  seene  is  a  bi-direetional  proeess.  The  forward  direetion  traeks  the  propaga¬ 
tion  of  solar  and  self-emitted  thermal  photons  as  they  are  seattered,  absorbed,  or 
transmitted  through  the  atmosphere,  refleet  off  the  target  and  various  non-target 
objeets,  travel  through  the  atmosphere  again,  and  enter  the  sensor.  Onee  inside  the 
sensor,  these  photons  interaet  with  the  instrument’s  optieal  and  dispersion  elements 
and  are  ultimately  absorbed  by  a  photoaetive  material.  The  resulting  eleetrieal  sig¬ 
nal  is  proeessed,  quantized,  and  eonverted  to  an  integer  number  stored  digitally  in  a 
eomputer.  The  forward  direetion  also  typieally  ineludes  a  button-hook  in  whieh  the 
final  sensor  produet  is  eommonly  eonverted  to  sensor-reaehing  radianee  through 
the  sensor-ealibration  proeess.  The  button-hook  metaphor  highlights  reverse  travel 
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Figure  4.2:  Target/image  space  model 


along  the  chain  back  through  the  sensor  to  the  physical  quantity,  usually  a  vital  step 
in  reflectance  retrieval. 

The  mathematical  model  of  radiation  transfer  is  presented  as  a  deterministic 
process  that  attempts  to  categorize  and  account  for  every  photon,  yet  the  ability 
of  an  observer  to  accurately  predict  and  measure  the  actual  events  that  occur  at 
each  point  in  the  radiation  chain  is  an  elusive  thing.  The  forward  radiation  chain 
can  be  abstracted  into  a  series  of  processes:  source  photon  arrival  at  earth,  scat¬ 
tering,  absorption,  and  reflection,  depicted  conceptually  in  figure  4.3,  where  each 
term  in  the  figure  corresponds  to  the  terms  in  equation  3.3.  Each  process  cannot 
be  perfectly  modeled  due  to  varying  degrees  of  inherent  uncertainty.  For  the  sun- 
earth  transport,  the  instantaneous  solar  exitance  is  not  fully  known.  For  scattering 
and  absorption,  the  exact  quantity  of  scattering  and  absorbing  species  is  not  fully 
known.  Neither  are  the  exact  orientation  of  the  ground  target,  the  material  proper¬ 
ties  of  tall  background  objects,  etc.  Some  of  these  may  be  guessed  at,  and  others 
may  be  modeled  or  measured  very  precisely,  but  ultimately  each  process  has  an 
inherent  amount  of  uncertainty  remaining  after  all  ordinary  methods  to  pin  down 
these  quantities  have  been  exhausted. 

In  the  forward  uncertainty  model,  a  three  level  uncertainty  chain,  shown  in  fig- 
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Figure  4.3:  Forward  uncertainty  chain  block  diagram 


ure  4.4,  will  be  established.  The  first  level  is  in  the  atmospheric  and  geometric 
parameters.  These  include  water  vapor  profile,  size  and  quantity  of  non-molecular 
particles  (aerosols),  type  and  quantity  of  well-mixed  molecular  gases,  temperature 
profile,  and  pressure  profile.  Clouds  are  a  special  case  of  atmospheric  parame¬ 
ter  that  will  be  treated  very  gingerly  by  this  research.  As  highly  absorbing  and 
scattering  bodies,  clouds  introduce  magnitude  discontinuities  that  make  it  difficult 
to  use  the  statistical  and  spatial  methods  that  will  be  presented.  The  first  level 
also  includes  the  geometric  parameters  that,  along  with  the  atmospheric  param¬ 
eters,  make  up  the  physical  world  in  which  radiation  transfer  and  detection  take 
place.  The  main  geometric  parameters  of  interest  are  the  sky  fraction  and  target 
orientation.  The  sky  is  masked  by  surrounding  terrain,  which  means  a  fraction  of 
the  albedo  assuming  to  be  coming  from  the  sky  is  actually  reflected  off  of  nearby 
objects  such  as  trees  and  buildings.  This  additional  reflection  changes  both  the 
magnitude  and  spectral  character  of  the  light  reflecting  off  the  target.  Together, 
clouds  and  background  constitute  a  poorly-modeled  perturbation  to  the  traditional 
sky  dome  model.  The  target  orientation  is  a  geometric  parameter  that,  when  in¬ 
adequately  measured,  modeled,  or  guessed  at  will  also  change  the  character  of  the 
reflected  light,  sometimes  drastically  so. 

The  second  part  of  the  uncertainty  chain  is  the  functional  abstraction  of  the  pa¬ 
rameters,  namely  the  terms  in  equation  4.18.  As  these  terms  are  the  product  of  the 
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Figure  4.4:  Three-level  uneertainty  ehain  bloek  diagram 


physieal  world  aeting  on  the  souree  photons,  they  all  have  a  physieal  dependenee 
on  the  state  of  the  atmospherie  and  geometrie  parameters.  However,  they  ean  also 
be  called  model  outputs  since  radiative  transfer  modeling  attempts  to  provide  the 
same  terms.  This  abstraction  level  also  includes  the  key  geometric  terms  that  are 
unrelated  to  measurement  of  the  atmosphere.  These  include  ground  target  tilt,  look 
angle,  sun  zenith  and  azimuth  angles,  and  sky  fraction. 

The  final  part  of  the  forward  chain  is  the  final  product,  which  is  either  sensor- 
reaching  radiance  or  digital  count  value  depending  on  the  application.  The  final 
producf’s  relafionship  wifh  fhe  model  oufpufs  is  deferminislically  defined  by  fhe 
radiafive  fransfer  equation,  so  bofh  fhe  value  and  ifs  error  are  relatively  easy  fo 
calculafe  provided  fhe  infermediafe  sfage  of  figure  4.4  is  sufficienfly  well  char- 
acferized.  Considerafion  of  digifal  counfs  insfead  of  sensor-reaching  radiance  re¬ 
quires  an  error  model  for  fhe  sensor,  while  a  chain  fhaf  slops  wifh  sensor-reaching 
radiance  is  dependenl  on  fhe  physical  world  only,  hence  is  porfable  fo  any  sensor 
system.  If  is  nol  implied  here  fhaf  fhe  sensor  can  be  ignored;  indeed,  fhe  insfrumenl 
can  be  a  source  of  speclacular  error  and  is  freafed  separalely. 


4.4  Error  propagation  in  analytical  functions 

4.4.1  Total  error 

Since  fhe  main  objective  of  fhe  research  is  fo  determine  fhe  relalive  effecfs  of  uncer- 
fainfy  reduclion  techniques  in  afmospheric  inversion,  if  is  necessary  fo  mafhemali- 
cally  describe  fhe  effecls  of  random  processes.  A  random  process  is  an  ensemble  of 
signals  or  oufcomes,  fhe  paramelers  of  which  are  randomly  selecfed  and  governed 
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by  some  probability  distribution.  A  specific  outcome  produced  when  the  random 
process  is  accessed  is  a  realization  of  the  process  (Peebles,  2001).  In  this  field  of 
study,  the  atmospheric  parameters  can  be  modeled  as  random  processes,  as  can 
random  noise  in  each  measurement. 

In  a  statistically  rigorous  treatment,  population  statistics  and  sample  statistics 
are  never  used  interchangeably.  Population  statistics  are  estimated  from  sample 
statistics,  and  even  measurement  of  an  entire  ’’population”  cannot  guarantee  the 
reliability  of  descriptive  statistics  regarding  the  likelihood  of  a  certain  behavior  or 
characteristic  in  a  marginal  addition  to  the  population.  One  can  use  metrics  such  as 
sample  size  to  gage  this  reliability,  but  there  is  no  way  to  truly  know  how  closely  the 
measured  statistics  match  the  population  statistics.  Although  special  effort  will  not 
be  spent  on  distinguishing  population  statistics  from  sample  statistics,  terminology 
traditionally  used  for  sample  standard  deviation,  S,  will  be  used  to  indicate  the 
standard  deviation  of  a  variable.  It  will  be  assumed  that  statistics  calculated  from 
the  sample  are  believed  to  be  sufficiently  close  to  the  population  statistic  for  the 
purposes  required  by  this  investigation. 

A  generic  function  y  of  multiple  variables,  xi  and  X2,  is  shown  in  equation  4.2. 
The  variable  y  is  an  estimator  of  that  function,  which  is  expressed  as  the  true  value 
y  plus  a  random  error  variable,  e,  as  shown  in  equation  4.3. 


y  =  /(xi,X2) 

(4.2) 

y  =  y  +  £ 

(4.3) 

Expressed  in  these  terms,  the  purpose  of  this  research  is  to  determine  the  sta¬ 
tistical  properties  of  e  as  applied  to  the  imaging  science  application  of  reflectance 
retrieval  in  hyperspectral  imagery.  The  properties  of  interest  are  the  bias  of  y, 
which  corresponds  to  the  expected  value  of  s,  and  the  variability  of  y,  which  will 
be  indicated  by  assuming  a  normal  distribution  for  e  and  using  its  variance.  Al¬ 
though  it  is  not  possible  to  fully  describe  a  probability  distribution  with  a  single 
number  -  the  shape  and  symmetry  are  unknown  without  further  description  -  the 
variance  or  its  square  root,  the  standard  deviation,  is  still  the  best  way  to  describe 
the  precision  of  a  measurement  (Barford,  1967).  The  estimator  bias  is  developed 
according  to  equation  4.4  and  expressed  in  equation  4.5.  The  variance  of  y  follows 
the  traditional  definition,  as  shown  in  equation  4.6.  Because  y  is  defined  as  the  true 
value  of  /  (x),  its  expected  value  is  always  the  value  itself  with  a  variance  of  zero. 
Therefore,  the  variability  of  the  estimator  y  is  equal  to  the  variability  of  the  error 
term  e. 
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E[y]  =  E[y  +  e] 

=  E[y]  +  E[e] 

=  y  +  E[e] 

(4.4) 

bias{y)  =  E[E[E]]=E[E[y]-y] 

(4.5) 

Var  {y)  =  E[y-E  [y]f  =  E[e-E  [e]]^ 

(4.6) 

The  bias  is  defined  as  the  expeeted  value  of  e.  However,  total  error  in  e  is 
the  true  goal  here.  The  random  deviations  in  e  are  eentered  on  the  mean  value  of 
e,  so  they  sum  to  zero  unless  the  sign  is  removed  by  taking  the  absolute  value  or 
squaring  the  term.  The  expeeted  value  of  the  squared  error  is  known  as  the  mean 
squared  error  and  is  one  of  the  most  eommon  methods  for  deseribing  variability 
in  a  random  variable.  It  is  developed  aeeording  to  equation  4.7  (Montgomery  and 
Runger,  1998). 

E[e^]  =  E[y-y\^ 

=  E[{y-E[y])  +  {E[y]-y)f 

=  E[{y-E[y]f+2{y-E  [y])  {E  [y]  -  y)  E  {E  [y]  -  yf 
=  E[y-E  [y]]2  +2{E[y]-E  [y])  {E  [y]  -E[y])+E[E  [y]  -  yf 
=  E[y-E[y]f+0  +  E[E[y]-yf 

=  V ar  (y)  +  bias  {yf  (4.7) 

4.4.2  Random  component 

Given  a  group  of  measurements  or  data  points,  the  sample  varianee  of  s  is  eom- 
puted  in  the  traditional  manner,  as  shown  in  equation  4.8.  It  would  not  be  eom- 
pletely  eorreet  to  equate  5^  to  the  expeeted  value  expression  in  equation  4.6,  but 
this  is  how  that  expeeted  value  expression  is  estimated.  From  this  point  forward, 
Sy  will  indieate  the  random  eomponent  of  the  error  in  a  generie  variable  y. 

N  „ 

E  {vi  -  yf 

q2  2  =  1 

Oy  — 


1 


(4.8) 
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Beers  (1957)  deseribes  a  method  of  building  upon  equation  4.8  to  derive  a 
method  of  propagating  random  error  in  a  funetion’s  eomponent  variables  to  random 
error  in  the  funetion  itself.  The  formulation  starts  with  the  same  generie  funetion  of 
two  variables  from  equation  4.2,  shown  in  expanded  form  using  a  Taylor  series  in 
equation  4.9,  whieh  is  then  squared  in  equation  4.10.  The  Taylor  series  is  truneated 
to  the  first  order. 


yi-y  =  {xu  -  xi)  ^  +  {X2i  -  X2)  ^  (4.9) 

OX  I  0x2 

{vi  -  yf  =  {xii  -  +  {x2i  -  x^f 

ox  I  0x2 

+  2{xii-xl){x2i-x^)p^p^  (4.10) 

axi  0x2 

The  equality  of  form  between  the  left-hand  side  of  equation  4.10  and  the  right- 
hand  side  numerator  of  equation  4.8  leads  to  the  insertion  of  both  sides  of  the 
former  into  the  latter,  produeing  equation  4.11.  The  definitions  of  sample  varianee 
and  eovarianee  are  then  used  to  simplify  the  expressions  to  produee  equation  4.12. 


^2  (XHJ-^ 

i=l 


+  {X2i  -  X2f 


dy  ■ 
dx2 


+  2  (xii  -  Xi)  (X2i  -  X2)  ^ 


dy  dy 
dx2 


N  -  1 


c2  _  c2  ^ 

y  dxi 


dx2 


^  +sl^  +25. 


dy  dy 


(4.11) 


(4.12) 


The  term  pij  denotes  the  eorrelation  eoeffieient  for  variables  Xj  and  Xj.  The 
expression  for  estimating  the  eorrelation  eoeffieient  for  two  sueh  variables  from 
a  series  of  observations  of  eaeh  is  given  in  equation  4.13.  It  allows  one  final 
subslifufion,  yielding  fhe  eommon  expression  for  error  propagation  using  partial 
derivatives.  There  is  more  fhan  one  way  fo  define  error  and  more  fhan  one  way  fo 
propagafe  if  forward  fhrough  a  sysfem,  buf  fhis  expression  was  ehosen  for  ifs  gen¬ 
eral  versafilify  and  widespread  use.  If  does  depend  upon  an  assumpfion  of  linearity 
because  of  fhe  fruncafed  Taylor  series,  buf  since  ofher  parfs  of  fhis  invesfigafion 
apply  fhe  same  assumpfion  of  local  linearify  rafher  liberally,  requiring  if  here  does 
nof  in  any  way  degrade  fhe  final  resulf. 


E  [X1X2]  _  Eill  {xii  -  Xl)  (X2j  -  X2) 


P{xiX2) 


SxiSx2 


{N-1)Sx,Sx2 


(4.13) 
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The  final  form  of  the  error  propagation  equation  is  presented  in  equation  4.14. 
The  generie  funetion  y  is  now  expanded  to  be  a  funetion  of  an  arbitrary  number 
of  variables,  xi  through  Xn-  When  there  are  more  than  two  variables,  all  possible 
eombinations  of  variables  produee  eovarianee  terms  that  must  be  ineluded. 


q2  _  ( c 

y  \dxi^ 


+  \Ns„ 


+ 


dx2 
dy  dy  ^  ^ 
axi  oxj  ^ 


dv  ''  ^ 

+  {^S. 

dx„ 


(4.14) 


The  expressions  presented  so  far  will  be  revisited  to  not  only  produee  the  spe- 
eitie  forms  of  error  propagation  funetions  themselves,  but  they  will  also  be  required 
to  support  the  eonstruetion  of  other  deterministie  funetions  using  the  random  vari¬ 
ables  eonsidered.  Speeifieally,  the  expression  for  retrieved  refieetanee  will  be  a 
deterministie  funetion  based  on  funetions  of  random  variables. 


4.4.3  Bias  component 

The  propagation  of  random  error  does  not  aeeount  for  all  types  of  possible  error  in 
a  result.  Bias  or  systematie  error  also  affeets  final  retrieval  results.  Normally,  it  is 
assumed  that  this  type  of  error  is  driven  as  low  as  possible  through  the  ealibration 
proeess.  In  faet,  no  bias  error  is  propagated  aeross  the  uneertainty  ehain  abstraetion 
levels  shown  in  figure  4.4.  However,  bias  will  be  present  in  the  final  result  due  to 
geometrie  effeets  on  imaging  that  are  traditionally  poorly  treated  or  eompletely 
ignored. 

Bias  error  starts  with  the  same  basie  equation  as  random  error,  repeated  as 
equation  4.15.  However,  instead  of  estimating  the  instantaneous  derivative  of  this 
funetion,  a  finite  distanee  will  be  traveled  in  x  to  produee  a  ehange  in  output  in  y. 
If  X  is  ineorreet  due  to  a  systematie  error,  then  the  differenee  in  y  is  the  systematie 
error  in  the  output,  as  shown  in  equation  4.16. 


y  =  f{xi,X2) 

(4.15) 

y  =  f  {xi  +  Axi,X2  +  Ax2) 

(4.16) 

Unlike  slope  ealeulated  for  random  error,  whieh  is  only  valid  elose  to  the  een- 
ter  point,  this  bias  differenee  only  depends  on  the  end  points,  as  shown  in  equation 
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4.17.  As  long  as  the  functional  relationship  is  valid,  the  bias  error  is  a  valid  cal¬ 
culation  regardless  of  distance.  Unlike  random  error,  bias  error  is  sign  dependent, 
with  each  effect  moving  the  cumulative  bias  in  one  direction  or  the  other. 

Aybias  =  y-y  (4.17) 

4.5  Governing  equation 

The  vital  question  to  be  considered  is  how  retrieved  reflectance  depends  on  its 
input  parameters,  and,  more  to  the  point,  how  sensitive  the  retrieved  reflectance  is 
to  errors  in  each  of  these  components.  The  basic  expression  of  this  concept  is  found 
in  equation  4.18.  Inverting  the  model  in  equation  3.5  produces  a  straightforward 
expression  of  the  reflectance  factor. 


^SR  Lu  Ladj 

COS  cJs'ri  +  {F2  {FiLd  +  (1  -  Fi)  Ldd)  +  (1  -  -^2)  T2 


(4.18) 


The  whole  activity  of  atmospheric  compensation  is  discovery  of  each  term  to 
sufficiently  high  precision.  Inversion  algorithms  always  attempt  to  provide  them 
using  a  variety  of  strategies.  Two  major  classes  of  strategies  that  are  consid¬ 
ered  here  are  ground  truth-based  methods  (mainly  the  empirical  line  method)  and 
model-based  methods.  The  empirical  line  method  (ELM)  attempts  to  determine 
all  of  the  parameters  at  once  in  a  manner  that  does  not  allow  explicit  separation  of 
individual  terms.  Model-based  methods  attempt  to  predict  the  state  of  the  actual 
atmosphere  at  the  time  the  image  was  taken  and  use  a  radiative  transfer  routine 
to  numerically  determine  the  outputs  required  for  the  inversion.  Thus,  inverted 
reflectance  may  also  be  considered  a  function  of  the  physical  atmospheric  param¬ 
eters,  a  concept  expressed  in  equation  4.19,  where  H2O  represents  column  water 
vapor,  AOD  represents  aerosol  optical  depth,  alt  represents  the  density  altitude, 
and  F  represents  the  fraction  of  the  sky  hemisphere  that  is  either  clear  or  obscured 
by  clouds  or  background  objects. 


r  =  f  {Ld,  Lu,ti,T2,  ...)  =  /  {H2O,  alt,  AOD,  Fsky,Fcloud,  ■  ■  ■)  (4.19) 

Parameter  selection  follows  those  used  by  Green  et  al.  (1993)  with  the  excep¬ 
tion  of  pressure  elevation.  Pressure  elevation  attempts  to  account  for  variation  in 
the  molecular  number  density  in  the  air  column  above  the  target  site.  The  amount 
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of  well-mixed  gas  varies  from  the  “standard  day”  profile  when  the  air  pressure  dif¬ 
fers  from  standard  pressure.  The  use  of  density  altitude  allows  for  further  variation 
in  the  air  eolumn,  aeeounting  for  temperature  effeets.  Density  altitude  is  pressure 
altitude  eorreeted  for  variations  from  standard  temperature,  whieh  is  at  least  as 
eommon  as  departures  from  standard  pressure  (Federal  Aviation  Administration, 
2003).  It  was  felt  that  aeeounting  for  both  effeets  would  allow  for  more  aeeurate 
modeling  and  not  leave  unaddressed  a  signifieant  souree  of  atmospherie  variability. 
It  levied  a  requirement  that  pressure  and  temperature  be  eolleeted  together,  whieh 
is  generally  the  ease  anyway.  In  MODTRAN,  the  variation  of  elevation  ehanges 
the  air  eolumn  using  both  the  pressure  and  temperature  settings,  so  density  altitude 
is  already  the  de  facto  parameter  used  in  radiative  transfer  modeling. 

The  switeh  from  one  type  of  altitude  to  the  other  required  only  the  modifieation 
of  the  equations  used  in  the  model  eode,  whereas  further  parameter  ehanges  in  the 
name  of  better  model  fidelity,  namely  inversion  layer  altitude,  would  have  foreed 
major  arehiteetural  ehanges  in  the  modeling  proeess  and  are  thought  to  not  add 
mueh  aeeuraey  to  the  final  resulfs.  As  long  as  a  single  surfaee  paramefer  aeeounfs 
for  fhe  fofal  quantify  of  moleeules  in  fhe  air  eolumn,  as  densify  alfifude  Iheorefieally 
does,  shifting  masses  of  air  verfieally  should  nol  ehange  fhe  resulf  in  fhe  limifed 
eases  sfudied  herein.  One  eould  imagine  fhe  sifuafion  in  whieh  fhe  posifioning  of 
a  eloud  layer  in  relafion  fo  fhe  inversion  alfifude  eould  affeel  illuminafion  slighfly, 
buf  fhaf  should  be  abouf  fhe  exfenf  of  fhe  unmodeled  error. 

There  are  an  infinite  number  of  variables  available  for  inelusion  in  equafion 
4.19,  mosf  of  whieh  perfain  fo  fhe  fype,  size,  and  number  densify  of  moleeules 
photons  may  eneounfer  as  fhey  fraverse  fhe  afmosphere.  The  remainder  perfain  fo 
sun-fargef-observer  geomefry. 

The  primary  eonsfifuenfs  responsible  for  afmospherie  absorpfion  are  wafer  va¬ 
por  (H2O),  earbon  dioxide  (CO2),  ozone  (O3),  nifrous  oxide  (N2O),  earbon  monox¬ 
ide  (CO),  mefhane  (CH4),  and  gaseous  oxygen  (O2)  (Gao  ef  ah,  1993),  whose  den¬ 
sities  are  generally  very  slowly  fime-varianf  and  spafially  invarianf.  As  a  resulf, 
fhese  are  referred  fo  as  well-mixed  fo  indieafe  fheir  homogeneify.  In  addifion  to 
fhese  major  eonfribufors,  fhere  are  fraee  quanfifies  of  various  pollufanfs,  ineluding 
NH3,  SO2,  HNO3,  and  several  ehlorollouroearbons  (CFCs)  whose  densities  are 
very  low  and  generally  nol  addressed.  However,  preliminary  researeh  showed  ra- 
diafive  fransporf  ean  be  highly  sensifive  to  fhese  large  moleeules.  Sinee  pollufanfs 
are  invarianf  neilher  lemporally  nor  spatially,  if  error  analysis  ever  reaehes  fhe  poinf 
of  prediefing  exfreme  aeeuraey.  Ibis  mighf  be  a  fertile  fulure  sfudy  area. 

There  are  seasonal  and  long  term  frends  in  well-mixed  gas  eoneenfrafion,  buf 
fheir  day-lo-day  eoneenfrafion  is  indexed  fo  lemperalure  and  pressure,  whieh  joinlly 
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determine  the  gaseous  density  of  the  atmosphere.  In  addition  to  moleeular  gases, 
there  are  two  other  important  atmospherie  eonstituents:  water  vapor  and  aerosols. 
Water  vapor  is  teehnieally  also  a  moleeular  gas,  but  it  is  treated  separately  beeause 
of  water  vapor’s  unique  role  in  global  elimatology.  As  part  of  the  water  eyele, 
water  vapor  is  highly  variable  in  loeation  and  eoneentration  over  a  short  period  of 
time  in  a  way  not  shared  by  the  other  gases.  Aerosols  are  partieles  suspended  in 
the  atmosphere  ranging  in  size  from  sub-mieron  to  millimeter  range.  These  have  a 
variety  of  sourees,  ineluding  terrestrial  dust,  water  vapor  droplets  from  oeean  foam 
and  eondensation,  and  industrial  soot  produets.  Aerosols  are  generated,  migrate, 
and  settle,  usually  over  the  eourse  of  days  or  weeks.  As  a  result,  they  are  also 
handled  independently  of  other  atmospherie  eonstituents. 

The  radiative  transfer  model  in  MODTRAN  handles  the  details  of  the  funetion 
/  and  its  inputs  in  equation  4.19.  For  the  reasons  stated  above  three  parameters 
are  singled  out  for  partieular  treatment:  water  vapor  eontent  {H2O),  pressure- 
temperature  seale  altitude  {alt),  and  aerosol  optieal  depth  (AOD).  These  deter¬ 
mine  the  amount  of  seattering  and  absorbing  speeies  photons  will  eneounter  and 
henee  the  values  for  transmissivity  and  seattered  radianee. 

A  word  of  explanation  regarding  the  use  of  seale  altitude  is  required.  Seale 
altitude  is  an  indireet  parameter.  It  is  a  single  value  that  indexes  two  separate 
parameters,  pressure  and  temperature,  to  a  single  value.  This  is  possible  beeause 
pressure  is  generally  well-behaved  in  its  vertieal  regression  as  modified  by  the  tem¬ 
perature.  In  aeronautieal  terms  this  ean  also  be  thought  of  as  the  density  altitude, 
and  this  term  more  preeisely  deseribes  the  eoneept  addressed  here.  Temperature 
and  pressure  together  determine  the  integrated  number  density  of  the  well-mixed 
gas  moleeules  in  the  vertieal  atmospherie  eolumn.  When  low  pressure  and/or  high 
temperature  exist,  the  eolumn  density  is  lower  sueh  that  the  integrated  number  den¬ 
sity  of  the  well-mixed  gas  moleeules  equals  the  density  of  seattering  speeies  that 
would  be  observed  had  the  ground  been  loeated  at  a  higher  or  lower  altitude  on 
a  standard  atmospherie  day.  This  will  ereate  the  odd  situation  that  pressure  and 
temperature  are  measured  direetly  as  vertieal  profiles,  whieh  in  furn  ean  be  fed  info 
fhe  modeling  soflware  as  liferal  profiles  buf  whose  error  models  are  determined  by 
inpuffing  seale  alfifude,  and  whose  modeling  oufpuf  is  expressed  as  a  moleeular 
number  density  or  opfieal  depfh. 

Eaeh  of  fhese  paramefers  is  fed  info  fhe  modeling  eode,  yef  eaeh  paramefer 
ilself  has  eommon  anfeeedenf  sourees:  wind  pafferns  and  weafher  fronls.  If  mighf 
be  desirable  fo  fraee  fhe  fhree  parameters  baek  fo  a  eommon  sef  of  independenf 
sourees,  buf  fhe  sysfems  are  loo  eomplex  fo  aeeuralely  prediel  behavior  in  fhe  eon- 
lexl  of  remote  sensing  model  generation.  The  relalionship  is  illuslraled  in  figure 
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4.5.  This  bears  mentioning  because  the  three  parameters  will  be  treated  as  inde¬ 
pendent  random  variables  although  there  is  undoubtedly  a  degree  of  correlation 
between  them.  However,  given  the  high  complexity  and  low  reliability  of  climate 
modeling  at  this  point,  the  assumption  of  independence  is  kept,  and  a  line  is  drawn 
here  such  that  parametric  characteristics  of  the  antecedent  sources  are  excluded  as 
potential  uncertainty-reduction  measurement  possibilities.  The  positive  side  effect 
is  the  atmospheric  parameters  that  remain  (equation  4. 19)  constitute  the  entirety  of 
measurable  quantities. 


Poorly-  Well- 

modeled  modeled 


Figure  4.5:  Breaks  in  the  modeling  chain  dictate  the  choice  of  independent  vari¬ 
ables 


4.6  Application  of  error  propagation  to  the  governing  equa¬ 
tions 

4.6.1  Main  equations 

Regardless  of  how  the  inversion  equation  is  written,  each  term  contains  a  degree 
of  inherent  error  that  propagates  to  the  final  result.  The  result  of  applying  the  error 
propagation  technique  to  general  inversion  equation  4.18  produces  the  main  equa¬ 
tions  that  will  be  treated  by  this  investigation,  included  in  detailed  form  for  com- 
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pleteness  in  appendix  A.  Equation  4.20  shows  the  initial  expression,  and  equation 
A.24  the  expanded  form.  It  is  eondensed  slightly  in  equation  A.26. 
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4.6.2  Correlation  coefficients 

Since  this  is  simply  an  application  of  the  partial  derivative  method  of  error  prop¬ 
agation  and  the  4  quantities  Ld,  Lu,  n,  and  T2  are  each  functions  of  the  same 
atmospheric  and  geometric  parameters,  the  correlations  between  each  pair  of  pa¬ 
rameters  must  be  considered.  In  this  case,  the  relationship  is  technically  a  stochas¬ 
tic  interaction  between  light  and  matter,  but  the  modeled  behavior  is  effectively 
a  deterministic  function  (the  exact  shape  of  which  is  determined  by  the  specific 
software  implementation). 

When  functions  of  a  single  random  variable  are  used  in  the  creation  of  other 
deterministic  functions,  the  correlation  between  these  functions  is  unity:  a  random 
variable  is  always  perfectly  correlated  with  itself,  irrespective  of  the  specific  func¬ 
tional  forms  in  which  the  variable  appears  (increasing  vs.  decreasing,  linear  vs. 
parabolic  vs.  exponential,  etc.).  When  two  or  more  random  variables  are  prop¬ 
agated,  correlations  are  also  propagated  by  using  substitution.  Thus,  in  order  to 
properly  model  the  known  correlations  between  the  radiometric  parameters,  it  is 
necessary  to  start  mathematically  at  an  earlier  point,  with  the  atmospheric  con¬ 
stituents,  and  derive  the  correlations  by  analysis. 
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Equation  4.21  illustrates  this  for  three  random  variables,  u,  v,  and  w,  and  two 
funetions  of  the  random  variables,  x  {u,  v,  w)  and  y  {u,  v,  w).  If  the  funetions  are 
linear  eombinations  (a  flat  n-dimensional  plane),  or  if  it  is  possible  to  assume  the 
funetions  are  linear  within  a  suffieiently  restrieted  range  about  the  point  for  whieh 
the  funetion  is  ealeulated,  then  funetions  x  and  y  may  be  reeast  in  first-order  ex¬ 
panded  form  in  equations  4.22  and  4.23. 
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Substituting  these  expressions  into  the  eovarianee  formula  allows  the  propaga¬ 
tion  of  eorrelation  terms  for  the  original  random  variables.  This  is  seen  in  equations 
4.24  and  4.25,  where  in  the  latter  equation  the  definitions  of  the  varianee  and  eo¬ 
varianee  are  applied  as  appropriate  for  the  eolleetion  of  terms. 
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The  covariance  terms  can  be  set  to  zero  because  of  the  assumption  of  statis¬ 
tical  independence  between  water  vapor  column  depth,  aerosol  optical  depth,  and 
density  altitude.  Equation  4.26  shows  this  simplified  expression.  Note  the  code 
underlying  the  uncertainty  propagation  model  uses  the  original  form  in  equation 
4.25  to  accommodate  any  future  need  to  model  correlations  between  atmospheric 
constituents,  with  the  relevant  terms  simply  configured  fo  be  zero  for  fhe  time  be¬ 
ing. 


du  du  +  dv  dv  +  dw  dw 


(4.26) 


The  final  sfep  is  fo  replace  fhe  nofional  variables  used  so  far  wifh  acfual  terms. 
Three  atmospheric  parameters  directly  affect  four  modeling  outputs,  producing  six 
correlation  pairs,  all  listed  in  equation  4.20.  Using  ti  and  as  examples,  the 
correlation  term  for  these  two  outputs  is  given  in  equation  4.27.  The  expression 
is  repeated  for  the  other  five  possible  combinafions  of  ri,  T2,  L^,  and  Lu  in  equa¬ 
tions  A.  14  fhrough  A.  19  and  incorporated  info  equation  A.24  (see  appendix  A). 
Nofe  fhaf  while  radiomefric  parameters  are  shown  fo  be  cross-correlated,  fhe  cross¬ 
correlation  ferms  befween  fhe  constituents  have  dropped  ouf  in  equation  4.27  as  a 
resulf  of  fhe  independence  assumption.  These  terms  still  exist  in  the  model  should 
reliable  nonzero  correlation  factors  become  available. 


2  dn  did  2  dn  did 
^20  QH^o  dH20  dalt  dalt 

2  dn  did 

^^^dAODdAOD  ^  ’ 

4.6.3  Partial  derivatives 

While  the  partial  derivatives  of  reflectance  with  respect  to  each  term  are  analytical 
functions,  finding  fhe  values  of  and  error  in  each  ferm  is  anofher  mailer  entirely. 
The  value  of  each  ferm  is  a  function  of  fhe  almospheric  paramelers  and  delermined 
by  fhe  radialive  Iransfer  code.  The  relalionship  is  described  conceplually  in  equa¬ 
tions  4.28  fo  4.31.  The  function  is  defined  by  fhe  radiative  Iransfer  code.  In  olher 
words,  a  single  piece  of  soffware  runs  over  all  fhe  almospheric  paramelers  simul- 
laneously  and  Iracks  several  differenl  quanlilies  during  fhe  course  of  ils  numeric 
inlegralion,  which  Ihen  become  fhe  modeling  oulpuls. 


+ 


n  =  h{H20,  alt,  AOD,...) 


(4.28) 
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T2  =  f2{H20,alt,A0D,...) 

(4.29) 

Ld  =  h{H20,  alt,  AOD,...) 

(4.30) 

Lu  =  U  {H2O,  alt,  AOD, . . .) 

(4.31) 

Because  there  is  no  analytical  form  for  the  functions  defining  the  modeling 
outputs,  the  error  in  each  output  is  only  marginally  better  defined  fhan  fhe  earlier 
expressions  for  error  in  refleclance.  However,  fhe  good  news  is  fhaf  fhey  can  be 
obfained  numerically.  The  reduced  forms  of  fhe  equafions  are  shown  in  equafions 
4.32  fhrough  4.35,  while  fhe  expanded  sef  of  relationships  are  included  as  equa- 
fions  A.20  fhrough  A.23.  Here,  fhe  behavior  of  fhe  afmosphere  is  fhe  funcfional 
space,  and  fhe  abilify  fo  “reach  back”  fhrough  fhe  nonlinear  space  fo  obfain  fhe 
partial  derivafives  wifh  respecf  fo  each  physical  afmospheric  parameter  requires 
fhe  applicafion  of  numerical  differenlialion  fechniques  (as  described  in  secfion  4.7) 
fo  fhe  radiative  Iransfer  code.  If  was  a  major  fask  of  fhis  research  fo  define  and 
quantify  fhe  relationships  expressed  by  equations  A.20  fhrough  A.23,  analyze  fhe 
relative  magnifude  of  each  of  fhe  ferms,  and  make  recommendations  for  ground 
frufh  measuremenf  nefworks  based  on  fhe  resulfs.  Nofe  fhaf  fhe  correlafion  coeffi- 
cienfs  befween  fhe  afmospheric  parameters  are  implicifly  assumed  fo  be  zero  due 
fo  fhe  assumpfion  of  sfafisfical  independence  sfafed  earlier. 


— 

^T2 


Si.  = 


sL  = 


dri 

dH20 

dT2 
dH20 
(  did 
\dH2O 
dLu 
dH20 


+(ls 

/  dT2 


^  idAOD^^^^ 


SUnO  + 


2  /  dL 


(4.32) 

(4.33) 

(4.34) 

(4.35) 


4.6.4  Bias  terms 

Three  effecls  are  modeled  fhaf  induce  bias  errors:  off-nadir  poinfing,  off-normal 
ground  fill  angle,  and  fhe  obscuration  of  clear  sky,  eifher  by  clouds  or  background 
objecfs.  The  underlying  models  for  deriving  each  effecl  (essentially  obfaining  fhe 
term  in  equation  4.16)  are  developed  in  secfion  4.13.  According  fo  equation  4.17, 
bias  error  is  fhe  difference  befween  fhe  assumed  effecf  and  fhe  acfual  effecf.  Ap¬ 
plying  Ibis  fo  fhe  governing  equation  4.18,  bias  terms  can  be  derived. 
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Off-nadir  pointing  affects  upwelled  path  radiance,  L^,  and  target-sensor  trans¬ 
missivity,  T2.  If  the  difference  between  the  nadir  and  off-nadir  path  lengths  is 
significant,  the  effect  may  affect  the  final  reflecfance  refrieval,  wifh  pafh  radiance 
increasing  and  fransmissivify  decreasing.  The  governing  equation  4.18  does  nof 
explicifly  specify  a  poinfing  angle,  buf  nadir  is  assumed  in  fhe  radiafive  fransfer 
process.  Therefore,  unless  if  is  accounfed  for  somehow  (and  model-based  algo- 
rifhms  do  defecf  poinfing  effecfs  during  afmospheric  deferminafion),  a  bias  error 
would  exisf.  Equafion  4.36  shows  fhis  relationship,  wifh  fhe  off-nadir  ferm  consid¬ 
ered  fhe  frufh  ferm  and  fhe  nadir-poinfing  ferm  considered  fhe  erroneous  esfimafe 
ferm  because  if  confains  fhe  blind  assumpfion. 

The  off-nadir  ferm  is  expressed  in  equafion  4.37.  The  angle  il)  represenfs  off- 
nadir  poinfing  angle,  wifh  0°  corresponding  fo  nadir  and  90°  corresponding  fo 
horizonfal.  The  subscripf  0  is  used  for  nadir  ferms,  and  V’  is  used  for  ferms  where 
fhe  poinfing  angle  is  non-zero.  There  is  an  azimufhal  dependence  fhaf  is  implicifly 
accounfed  for  in  fhe  modeling  process.  Nofe  fhaf  in  equafion  4.37  fhe  downwelled, 
cloud,  and  background  terms  are  condensed  into  the  term,  indicating  zero  sky 
fractions  for  clouds  or  background  objects  (for  now).  The  difference  is  expanded 
in  equation  4.38. 


Ar  =  ro  - 


(4.36) 


r^p  = 


LsR  — 


^r,i,  = 


(^coscJs'ri  -h  Ldj  r2,v> 

_  ^2,11}  {Lsr  —  Lufi)  —  T2fl  {Lsr  — 


cos  as'Tl  +  T2,^T2fi 


(4.37) 

(4.38) 


Off-normal  ground  tilt  can  be  a  troublesome  effect  because  no  algorithm  can 
adequately  distinguish  a  cosine-induced  radiance  change  from  an  actual  variation 
in  reflectance.  The  affected  cosine  term  resides  in  the  denominator  of  equation 
4.18,  shown  in  equation  4.39.  Normally,  ag'  has  a  sun-sensor  geometry  component 
and  a  local  normal  component,  shown  in  figure  4.16,  buf  fhe  local  normal  compo- 
nenf  is  normally  assumed  fo  be  zero  unless  explicifly  measured.  The  ferm  amt  is 
used  fo  frack  a  ferm  wifh  a  non-zero  local  normal  componenf  (fhe  solar  geomefry 
componenf  is  fhe  same).  The  bias  difference  is  expanded  in  equafion  4.40. 


I-'SR,tilt  L/-U 


COS  atiitn  +  Ldj 


T2 


(4.39) 
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^nut 


{Lsr  -  Lu)  (cos  atilt  -  cos  as') 
cos  as'Ti  +  Ldj  cos  atiitn  +  Laj  T2 


(4.40) 


An  unknown  bias  in  the  radiometric  calibration  of  a  remote  sensing  instrument 
can  have  a  dominant  effect  on  the  retrieved  reflectance.  Bias  can  be  dependent 
on  signal  level  or  be  a  straight  increase  or  decrease  in  signal  independent  of  scene 
brightness.  The  error  propagation  model  is  capable  of  handling  either  case.  The 
modeling  technique  is  very  straightforward.  Given  a  miscalibrated  radiance  term 
Lsr  that  includes  the  sensor  bias,  the  expression  for  reflectance  bias  as  a  function 
of  radiometric  calibration  bias  is  shown  in  equation  4.41. 


Er-Lsr 
(^^COSO-^/Tl  +  Ldj  T2 

The  final  bias  error  sources  are  due  to  clouds  and  background  objects.  These 
are  explicitly  assumed  to  affect  only  downwelled  sky  radiance  and  not  either  direct 
path  to  or  from  the  target.  Equation  4.42  shows  this,  where  Lsky  is  used  to  represent 
the  composite  downwelled  radiance  resulting  from  non- zero  cloud  and  background 
sky  fractions.  The  general  form  is  given  in  equation  4.43,  where  specificity  to  either 
clouds  or  background  objects  alone  is  accomplished  by  setting  the  complementary 
sky  fraction  term  to  zero. 


'I"  sky  — 


Lsr  —  Lu 


^^sky 


(^COSCr^/Tl  +  Lsky^  T2 

{L/SR  Ld) 


( ^  cos  agfTi  +Ld]  COS  fJs/Ti  +  Lsky) 


(4.42) 


(4.43) 


4.7  Numerically-determined  derivatives 

The  error  analysis  requires  the  numerical  computation  of  partial  first  derivatives, 
which  are  used  in  equations  A.  14  through  A.  19  and  A.20  through  A.23.  The  first 
derivative  of  a  function  describes  the  function’s  rate  of  change  or  instantaneous 
slope  of  the  function.  This  quantity  tells  how  much  the  function  changes  with  re¬ 
spect  to  a  change  in  an  input  variable.  The  function  in  question  is  the  effect  of 
the  atmosphere  as  modeled  by  MODTRAN.  The  independent  variables  are  MOD- 
TRAN’s  input  parameters.  The  components  of  the  gradient  will  be  calculated  and 
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compared  to  each  other.  As  will  be  demonstrated,  correctly  calculating  the  deriva¬ 
tive  depends  on  the  magnitude  of  the  function  and  its  derivatives.  Functional  and 
machine  error  in  calculating  derivatives  are  “modeling  overhead”  that  cannot  be 
fully  avoided  but  add  nothing  to  the  modeling  results.  Both  need  to  be  minimized 
with  sufficient  due  diligence  and  attention  paid  to  the  fact  that  a  discrete  step  size 
either  too  large  or  too  small  will  increase  one  of  these  error  sources.  With  multi¬ 
ple  variables,  that  additional  danger  exists  that  relative  differences  in  these  sources 
between  variables  could  be  misinterpreted  as  a  model  result.  Until  the  behavior  of 
the  function  as  a  function  of  each  input  parameter  is  better  understood,  there  will 
be  an  emphasis  on  error  reduction  when  calculating  the  first  derivative. 

4.7.1  General  equations 

The  basic  formulation  of  the  derivative  of  a  single  variable  is  given  in  equation 
4.44.  When  extended  to  a  multivariable  function,  the  partial  derivative  is  defined 
by  equafion  4.45.  When  applied  fo  analytical  expressions,  fhe  procedure  for  finding 
a  derivafive  or  parfial  derivative  is  essentially  fhe  same  for  each,  wifh  fhe  variables 
for  which  fhe  parfial  derivative  is  nol  being  defermined  being  freafed  as  consfanfs. 
When  fhe  partial  derivafives  of  /  (xi  ,X2,  ■  ■  ■ ,  Xn)  are  grouped  fogefher  as  a  vector, 
fhe  resulf  is  termed  fhe  gradienf,  or  V/  {xi,X2,  •  •  • ,  Xn)  (Sfewarf,  1995).  The  gra- 
dienf  vector  has  a  fhree-dimensional  physical  analogy,  which  is  fhaf  if  defermines 
fhe  slope  of  a  surface  in  each  of  fhe  unif  vector  direcfions.  The  directional  deriva¬ 
tive  is  fhe  slope  of  such  a  surface  in  an  arbifrary  direcfion,  and  if  is  calculated  using 
fhe  gradienf. 


df{x)  /  (x -f  Ax)  -  /  (x) 

— 1 —  =  - X - 

ax  Ax^o  Ax 


(4.44) 


df{xi,X2)  /(xi  -f  Axi,X2)  -  /(xi,X2) 

- X - =  hm  - - -  (4.45) 

oxi  Axi^o  Axi 

The  concepf  of  fhe  slope  of  a  surface  does  nol  have  a  direcf  physical  analogy  to 
fhe  problem  under  currenl  consideration,  buf  fhe  usage  is  fhe  same.  If  is  desired  to 
delermine  which  direction  has  fhe  grealesl  rate  of  change.  In  fhe  physical  casling  of 
fhe  problem,  each  unif  veclor  represenls  an  aclual  direcfion.  In  Ibis  problem,  each 
unif  veclor  represenls  an  independenl  almospheric  parameter,  and  fhe  funclional 
oulpul  is  fhe  al-sensor  radiance.  The  funclion  ilself  is  fhe  physics-based  numerical 
radialive  Iransfer  code,  MODTRAN  in  Ihis  case.  The  inslanlaneous  rate  of  change 
of  fhe  al-sensor  radiance  in  response  lo  an  infinilesimal  change  in  an  inpuf  param¬ 
eter  is  useful  because  if  characlerizes  fhe  behavior  of  fhe  syslem,  which  is  useful. 
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in  turn,  in  that  inputs  can  be  related  to  outputs.  In  non-linear  systems,  such  a  rela¬ 
tionship  can  be  difficult  to  determine  by  other  means.  This  technique  is  the  basic 
approach  used  by  algorithms  that  seek  to  perform  nonlinear  optimization,  though 
moving  through  the  nonlinear  vector  space  is  not  of  immediate  interest  (McIntyre, 
2004).  However,  the  method  of  obtaining  derivatives  is  applicable. 

When  a  function  has  no  analytical  expression,  or  if  data  are  collected  without 
direct  access  to  the  underlying  physical  relationship,  one  must  resort  to  numerical 
methods  of  estimating  the  derivatives.  Because  no  direct  analytical  expression  for 
“the  atmosphere”  is  available,  numerical  techniques  are  thus  required.  The  most 
common  way  to  do  this  is  described  in  Dennis  and  Schnabel  (1996)  and  shown  in 
equation  4.46.  The  expression  is  a  result  of  truncating  and  rearranging  the  tradi¬ 
tional  Taylor  series  expansion  of  /  (x  -|-  Ax),  as  explained  in  Press  et  al.  (1990). 
The  form  of  the  Taylor  series  is  given  as  equation  4.47,  and  the  rearrangement  is 
shown  in  equation  4.48,  but  in  univariate  form.  The  higher  order  terms  of  the  se¬ 
ries  are  then  discarded  leaving  the  form  in  equation  4.46,  which  has  been  trivially 
extended  to  the  multivariate  form. 

dfixi,X2)  /(xi  -h  Axi,X2)  -  /(xi,X2) 

- Aii - 

/  (X  +  Ax)  =  /  (x)  +  Ax/'  (X)  +  .  (4.47) 

/  (x  -h  Ax)  -  /  (x)  4./  ^  ^  Ax/"  (x)  Ax^f”  (x) 

- AS - =  - 3! - 

There  are  other  techniques  for  numerically  estimating  a  first  derivative  of  a 
function,  such  as  guessing  an  exponential  form  and  performing  a  least-squares 
curve  fit  or  fitting  a  Chebychev  polynomial  to  the  univariate  curve  and  using  the 
analytical  derivative  (Press  et  ah,  1990).  However,  because  the  objective  of  this 
portion  of  the  work  is  to  compare  the  components  of  the  function’s  gradient  to 
each  other  at  a  small  number  of  selected  points  rather  than  compute  the  derivative 
at  a  large  number  of  points,  these  approaches  would  be  inappropriate.  Addition¬ 
ally,  the  numerical  methods  discussed  are  sufficient  for  the  intended  use  and  avoid 
some  of  the  artifact  problems  inherent  in  polynomial  curve  fitting,  such  as  periodic 
instability  that  increases  at  the  edges.  This  is  illustrated  in  figure  4.6,  where  a  curve 
fif  was  affempfed  on  fransmission  dafa  as  a  function  of  visibilify. 
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Percent  difference,  two-point  siope  vs  Chebyshev  fit  siope 


Figure  4.6:  Error  comparison  for  Chebyshev  curve  fit-derived  slope 


4.7.2  Error  considerations 

Because  of  the  truncation  of  equation  4.48  and  the  non-infinitesimal  step  size,  there 
is  a  degree  of  error  inherent  in  the  finite  difference  method  of  calculating  numer¬ 
ical  derivatives.  According  to  Press  et  al.  (1990),  in  addition  to  error  introduced 
by  the  truncation  of  the  higher  order  terms  of  equation  4.48,  inexact  variable  stor¬ 
age,  machine  precision,  and  errors  in  the  calculation  of  /  (x, . . .)  cause  significant 
problems.  The  combination  of  these  error  sources  means  that  an  optimal  finite  step 
size  can  be  neither  very  large  (for  the  sake  of  the  truncation  errors,  which  are  a 
failure  in  assumptions  underlying  finite  difference  methods)  nor  very  small  (due  to 
the  functional/machine  noise).  This  claim  is  supported  by  figure  4.7.  In  the  figure, 
an  example  function’s  derivative  was  numerically  computed  using  equation  4.46. 
The  step  size  (denominator  of  equation  4.46),  is  varied  along  the  x-axis.  When 
the  step  size  is  large,  systematic  error  is  dominant.  As  the  step  size  decreases,  the 
derivative’s  value  settles  to  its  best  approximation.  As  step  size  decreases  even  fur¬ 
ther,  then  machine  effects  take  over  creating  first  small  fluctuations  in  value  then 
large  ones.  At  the  smallest  step  sizes,  the  value  goes  completely  haywire  and  is 
essentially  pure  noise. 

It  is  important  to  minimize  the  error  where  possible,  and  it  is  also  useful  to  have 
an  estimate  of  the  error.  There  are  three  steps  in  Press  et  al.  (1990)  that  are  easily 
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Numerical  derivative  vs.  Step  size 


Step  size 


Figure  4.7 :  A  comparison  of  systematic  and  functional  error  sources  in  functions 


taken  to  reduce  errors.  The  first  involves  storing  and  retrieving  the  step  size  Ax 
to/from  the  computer’s  memory.  This  mitigates  the  effect  of  machine  truncation 
when  translating  the  number  to  a  specific  data  type  since  the  actual  step  size  used 
will  be  rounded  off  beforehand  and  will  not  change  during  the  computation.  This 
method  is  not  applicable  when  using  MODTRAN  as  the  function  because  it  reads 
text  configuration  files,  and  the  user  has  no  control  over  the  machine  storage  of 
variables.  Pre-truncating  the  step-size  variable  used  in  calculating  the  derivative 
will  not  guarantee  the  same  number  is  used  in  both  cases. 

The  second  strategy  for  error  reduction  is  to  use  a  form  of  4.46  that  is  cen¬ 
tered  on  the  point  of  interest  rather  than  using  it  as  an  endpoint.  The  reformulated 
method  is  presented  as  equation  4.49.  This  technique  is  highly  effective,  but  it 
only  reduces  systematic  error  and  does  not  affect  machine  precision  error.  How¬ 
ever,  this  added  leeway  is  essential  in  the  specific  case  of  using  MODTRAN  as 
a  functional  operator.  It  permits  the  step  size  calculation  to  err  on  the  high  side 
with  greatly  reduced  effect  on  the  calculated  slopes  and  the  avoidance  of  a  very 
dominant  machine  precision  error  regime. 


SLOPE  CALCULATION  USING  MODTRAN 


55 


df  {xi,X2)  ^  f{xi+  Axi,  X2)  -  f  {xi-  Axi,  X2) 

dxi  ~  2Axi  ^  ’ 

The  final  step  suggested  is  to  seleet  an  optimal  step  size.  Figure  4.7  makes  the 
necessity  of  this  recommendation  obvious.  Optimal  step  size  can  deliver  accuracy 
in  computing  the  first  derivative  on  the  order  of  the  square  root  of  the  machine  pre¬ 
cision  when  using  equation  4.46  or  the  squared  cube  root  of  the  machine  precision 
when  using  equation  4.49  (Press  et  ah,  1990).  It  is  possible  to  analytically  deter¬ 
mine  an  appropriate  order  of  magnitude  for  the  step  size  if  additional  information 
about  the  function  is  available  or  estimable.  Absent  that,  one  can  empirically  cal¬ 
culate  the  optimal  derivative  step  size  either  via  brute  force  or  using  a  numerical 
method  such  as  Ridders’  method  (Ridders,  1982),  which  generally  requires  less 
calculations  of  the  function  as  well  as  providing  an  estimate  of  the  error. 

The  cost  of  computing  valuations  of  /  (x, . . .)  is  typically  a  significant  factor 
when  determining  how  to  reduce  error,  but  in  the  case  of  this  investigation  the 
time  and  computational  resources  are  available  to  perform  detailed  calculations  for 
some  or  all  of  the  variables  and  input  variables  used.  The  current  functional  speed 
can  range  from  under  0.5  up  to  30  minutes  depending  on  the  spectral  resolution 
and  multiple  scattering  settings  selected.  If  this  work  moves  out  of  the  lab  and  into 
an  operational  setting,  these  considerations  will  become  important,  but  for  the  time 
being  the  chosen  method  of  implementing  the  third  recommendation  is  to  repro¬ 
duce  figure  4.7  for  each  atmospheric  parameter  and  determine  an  optimal  ’’stable” 
region  taking  into  account  all  spectral  bands.  It  is  the  most  time-consuming  and 
labor-intensive  method  of  doing  it,  but  it  is  also  the  most  rigorous  and  reliable. 


4.8  Slope  calculation  using  MODTRAN 

There  are  three  simple  steps  to  applying  equation  4.49  to  solve  for  the  appropriate 
terms  in  equations  A.20  through  A.23.  They  are  determine  the  appropriate  step 
size,  run  MODTRAN  twice  with  varied  inputs,  and  calculate  the  change  in  spectral 
output  per  change  in  parameter  input.  Determining  the  nature  of  the  functional 
space  using  multiple  MODTRAN  runs  is  not  a  new  idea;  in  fact,  there  is  at  least 
one  commercial  product  that  performs  multiple  runs  automatically  (Schlapfer  and 
Nieke,  2005).  While  it  can  be  useful  to  map  out  the  entire  functional  space  to 
provide  a  double-check  on  the  output’s  behavior,  it  is  much  more  practical  to  get 
the  step  size  determination  correct  the  first  time  and  enjoy  the  reduced  processing 
requirements  when  examining  any  scenario  variations  thereafter. 
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It  has  been  verified  in  preliminary  ealeulations  (as  part  of  seetion  5.1.1)  that 
funetional  errors  driven  by  the  MODTRAN  output  preeision  (rather  than  inter¬ 
nal  storage  errors)  dominate  the  numerieal  error  eonsiderations,  with  systematie 
approximation  errors  in  a  distant  (but  signitieant)  seeond  plaee.  There  is  a  very 
narrow  window  where  both  errors  of  the  type  inherent  in  equation  4.49  and  MOD¬ 
TRAN  funetional  error  ean  be  avoided.  The  window  only  exists  beeause  the  behav¬ 
iors  involved  are  smooth  and  gently  varying,  so  while  funetional  errors  prevent  the 
use  of  any  reasonably  small  step  size,  Taylor  series  truneation  errors  aeeumulate 
slowly.  This  is  true  for  total  water  vapor  eolumn  amount,  aerosol  optieal  depth, 
and  surfaee  pressure/temperature  seale  height.  As  is  shown  in  seetion  5.1.1,  a  very 
large  atmospherie  parameter  step  size  is  needed  to  find  this  window  in  the  first 
plaee.  Step  size  ean  be  eomputed  in  detail,  at  high  eomputational  expense,  for  one 
point  in  the  input  parameter  spaee  and  then  adapted  for  use  at  other  points  using 
the  approximation  as  a  guide. 

Although  slope  results  are  not  neeessarily  being  presented  here,  it  is  appropri¬ 
ate  to  mention  what  step  sizes  were  ehosen  and  how.  The  graphs  in  seetion  5.1.1 
show  several  surprising  effeets.  The  different  plot  eurves  represent  a  sampling  of 
wavelengths  between  400  nm  and  2500  nm,  roughly  200  nm  apart.  This  was  done 
to  show  the  wide  variety  of  behavior  within  the  speetrum  of  a  single  parameter. 

Three  main  effeets  are  observed.  First,  on  the  left-hand  edge  of  most  eurves  is 
the  maehine  noise  regime,  eaused  by  limitations  in  storing  real  numbers  as  single- 
or  double-preeision  floating  point  variables.  Even  double-preeision  variables  ean 
oeeasionally  be  suseeptible  to  errors  simply  beeause  the  magnitude  of  the  numbers 
involved  ean  be  on  the  order  of  10^^®.  The  other  two  are  on  the  right-hand  side  of 
some  of  the  plots,  where  there  exist  both  non-periodie  variation  and  periodie  varia¬ 
tion.  The  non-periodie  variation  is  the  slope  approximation  error  diseussed  earlier. 
In  some  eases  it  eonverges  quiekly,  and  in  others  it  appears  to  barely  eonverge  at 
all.  The  periodie  variation,  whieh  appears  primarily  in  the  ealeulations  for  ri,  is  an 
effeet  that  has  not  yet  been  diseussed.  It  is  a  form  of  truneation  error  similar  to  the 
maehine  preeision  issue,  but  it  manifests  as  roundoff  in  the  ASCII  text  output  files. 
Consider  two  MODTRAN  tape  deeks  run  with  slightly  different  parameters:  the 
outputs  are  identieal  to  two,  three,  or  four  plaees  (depending  on  how  many  plaees 
were  reported  in  the  text  output)  due  to  roundoff.  The  two  distinet  inputs  are  used 
as  the  denominators  in  equation  4.49.  This  ereates  a  eharaeteristie  sawtooth  pattern 
in  the  slope,  whereas  the  original  output  was  stair-stepped.  Assuming  the  roundoff 
follows  the  eommon  rule,  the  best  estimate  for  the  slope  is  halfway  up  the  side  of 
a  “tooth.” 

These  eharaeteristies  indieate  the  presenee  of  error  in  some  of  the  eurves.  The 
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amount  of  error  one  is  willing  to  live  with  is  a  key  question  beeause  these  eurves 
are  essentially  the  main  guts  of  the  entire  modeling  effort.  A  mitigating  faetor 
is  that  for  the  majority  of  the  eurves,  there  exists  a  relatively  stable  region  where 
it  is  possible  to  piek  a  good  step  size.  In  bands  where  this  is  not  the  ease,  the 
problems  transeend  mere  step  size  seleetion.  Colliding  error  regimes  not  only  make 
it  diffieult  to  ehoose  a  step  size,  but  they  also  have  the  primary  effeet  of  inereasing 
the  amount  of  error  observed. 

Options  exist  for  redueing  the  variation  and  its  impaet  on  slope  ealeulation. 
Although  none  of  these  was  implemented  here,  future  work  may  eonsider  them. 
A  permanent  fix  would  be  to  re-engineer  then  re-eompile  the  radiative  transfer 
eode  where  possible  to  earry  along  the  maximum  amount  of  preeision  available 
and  report  answers  to  a  greater  preeision.  Sinee  treating  MODTRAN  as  anything 
other  than  a  blaek  box  is  outside  the  seope  of  this  work,  it  was  not  pursued.  It 
would  be  possible  to  seleet  different  step  sizes  for  eaeh  band  that  best  fit  eaeh 
eurve’s  individual  behavior.  This  was  not  pursued  beeause  it  was  not  praetieal 
to  manually  examine  some  12,000  eurves,  and  there  is  no  guarantee  the  results 
would  be  transportable  to  other  sensing  eonfigurations.  Fitting  a  eurve  to  the  data 
was  previously  rejeeted  as  a  slope  ealeulation  strategy,  and  not  only  beeause  it 
requires  many  more  MODTRAN  runs  but  also  there  is  the  real  possibility  of  having 
to  supervise  eoeffieient  seleetion  for  many  of  these  12,000  eurves.  However,  it 
does  have  a  niee  side  effeet  of  finding  fhe  solufion  wifh  fhe  leasf  squared  error  and 
eliminating  mueh  of  fhe  random  Jiffer  presenf  in  fhe  resulfs. 

If  is  believed  fhaf  fhe  final  values  ehosen  represenf  somefhing  akin  fo  a  “naf- 
ural  frequeney”  wifh  respeef  fo  fhe  behavior  of  fhe  real-world  systems  fhaf  would 
fransporf  well  fo  ofher  sensing  seenarios.  They  are  0.25  em  or  2.5  mm  of  fofal 
preeipifable  wafer  vapor,  0.1  km  or  100  m  in  densify  alfifude,  and  2  km  of  hori- 
zonfal  visibilify.  The  visibilify  sfep  size  has  a  nonlinear  relafionship  fo  verfieal  and 
slanf-range  aerosol  opfieal  depfh  sfep  size  fhaf  is  eompufed  infernally  eaeh  lime  fhe 
model  is  run.  This  value  is  refrieved  and  used,  buf  beeause  if  is  a  funefion  of  fhe 
baseline  visibilify  no  sel  number  is  used  aeross  fhe  board. 


4.9  Uncertainty  in  atmospheric  parameters 

In  previous  seefions  fhe  meehanism  of  error  modeling  has  been  developed,  and 
fhis  frealmenf  of  error  in  fhe  afmospherie  variables  now  opens  up  fhe  model’s  in- 
lerfaee.  The  abilify  fo  speeify  fhe  amounf  of  error  presenf  in  eaeh  basie  term  is 
preeisely  whal  allows  fhe  model  fo  be  exereised  in  various  ways.  The  primary  ea- 
pabilifies  are  fo  predief  fhe  amounf  of  error  in  inversion  resulfs,  lesl  eombinalions 
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of  algorithms  and  instruments,  and  estimate  error  performanee-per-eost  (monetary 
or  eomputational). 

The  next  terms  that  will  be  eonsidered  are  the  uneertainty  in  the  water  vapor 
eolumn  depth,  density  altitude,  and  aerosol  optieal  depth.  They  have  been  denoted 
as  Sh20>  Salt,  and  Saod-  They  are  treated  here  as  synonymous  as  the  standard 
deviations  of  these  terms,  but  this  begs  the  question,  “Of  what  data  set  are  they 
the  standard  deviation?”  The  eoneept  of  uneertainty  inherent  in  these  parameters 
somewhat  transeends  a  statistieal  definition,  but  as  is  usually  the  ease,  using  inher¬ 
ent  uneertainty  in  praetiee  means  eomputing  the  standard  deviation  of  sample  data 
to  estimate  it.  However,  the  data  for  whieh  statisties  are  ealeulated  depends  on  the 
souree.  There  are  three  main  eategories  of  input  sourees:  inherent  estimates  an- 
ehored  to  a  speeifie  loeation,  ground  instrument  estimates,  and  in-seene  algorithm 
estimates.  Eaeh  souree  of  parameters  also  is  a  souree  of  parameter  estimation  un¬ 
eertainty. 

Stripped  down  to  bare  bones,  model-based  algorithms  isolate  refleetanee  by 
estimating  every  other  term  in  the  model.  All  model-based  inversion  algorithms 
all  need  to  somehow  provide  the  parameters  eurrently  under  eonsideration.  This 
serves  as  the  eommon  framework  from  whieh  any  sueh  algorithm  ean  be  deeom- 
posed  and  analyzed.  At  this  level  of  abstraetion,  inputs  ean  be  readily  substituted, 
perhaps  to  trade  high  uneertainty  for  lower  uneertainty.  The  baseline  eireumstanees 
for  doing  this  is  augmenting  or  eheeking  in-seene  parameter  retrieval  algorithms 
with  ground  instruments.  Most  often  field  insfrumenfs  are  used  fo  validate  final 
resulfs,  i.e.  fhe  refrieved  refleelanee,  beeause  fhis  is  eonsidered  fo  be  fhe  mosf  ef- 
feelive  use  of  fhe  resouree  (look  fo  Sfaenz  (2002)  and  Goefz  ef  al.  (2003)for  ready 
examples).  Validafion  of  refrieval  algorifhms  is  fhe  usual  mofivafion  for  measuring 
afmospherie  eonsfifuenfs  in  supporf  of  remofe  sensing  (an  example  is  diseussed  by 
Kaufman  ef  al.  (1997)),  buf  if  is  also  possible  fo  hybridize  in-seene  inversion  algo- 
rifhms  fhrough  fusion  wifh  ground  frufh  measuremenfs.  This  feehnique  has  been 
employed  in  supporf  of  Landsaf/HyMap  (Roehford  ef  ah,  2005)  and  AVIRIS  (Clark 
el  ah,  1995)  and  holds  fhe  pofenfial  fo  eorreef  less  preeise  insfrumenfs  and  extend 
fhe  eapabililies  of  insfrumenfs  lhal  laek  or  have  poorly-seleeled  speelral  bands  for 
in-seene  eonsliluenl  refrieval. 

4.9.1  Error  sources  from  climatology 

When  esfimafing  an  afmospherie  parameler  wilhoul  having  made  any  measure- 
menls,  inherenf  uneerlainly  or  inherenl  error  is  fhe  error  figure  aulomalieally  al- 
laehed  fo  fhe  eslimale.  If  is  a  properly  of  geographie  area,  and  whereas  if  is  eom¬ 
mon  fo  express  average  values  for  an  area,  if  is  basieally  unheard  of  fo  reporf  lypieal 
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uncertainty  in  those  values.  However,  to  those  properly  trained,  a  reported  value  is 
nearly  meaningless  unless  its  uncertainty  is  also  given,  and  it  is  no  different  in  this 
case.  While  the  concept  of  inherent  uncertainty  may  be  somewhat  esoteric,  it  tends 
to  appear  often  and  almost  always  without  acknowledgment.  Whenever  a  study 
reports  that  the  “MODTRAN  default”  values  (including  the  use  of  the  ubiquitous 
mid-latitude  summer  atmospheric  model)  were  used  to  predict  expected  values  or 
assist  in  atmospheric  inversion,  inherent  uncertainty  drives  the  output  error.  The 
six  model  atmospheres  available  in  MODTRAN  are  themselves  attempts  to  report 
geography-based  average  values  in  a  way  most  useful  to  the  modeling  code’s  many 
users. 

Weather  and  climate  patterns  create  a  natural  probability  distribution  for  each 
of  the  atmospheric  parameters.  This  implies  that  with  no  prior  knowledge  of  actual 
atmospheric  conditions,  it  is  possible  to  make  an  approximate  guess  with  a  degree 
of  uncertainty  dictated  by  the  local  area’s  climatology.  The  nature  of  this  distri¬ 
bution  is  determined  solely  on  the  past  weather  history  of  the  area  being  studied. 
This  characterization  of  an  area  must  be  accomplished  beforehand,  since  it  involves 
culling  archived  weather  observations  and  constructing  statistical  models  based  on 
that  data.  The  construction  of  a  statistical  model  simply  involves  calculation  of  the 
standard  deviation  of  each  atmospheric  parameter,  which  is  usually  a  derived  result 
from  an  operational  ground  measurement  data  set. 

Once  atmospheric  observations  have  been  collected,  it  is  generally  preferable 
and  straightforward  (but  tedious)  to  slice  the  data  along  temporal  lines,  making 
distinction  by  time  of  year  and  time  of  day.  Indeed,  the  default  MODTRAN  atmo¬ 
spheres  are  themselves  split  according  to  summer  and  winter.  Grouping  by  time 
of  year  and  by  time  of  day  are  both  useful,  provided  adequate  data  are  available. 
In  this  analysis,  data  were  grouped  by  month  but  not  by  time  of  day  because  al¬ 
though  most  data  are  time-stamped,  the  date  of  the  observation  is  more  universally 
available  than  the  time  of  the  observation. 

Presenting  inherent  error  is  more  of  a  conceptual  exercise  than  a  practical  tool. 
Unless  someone  happens  to  be  curious  about  an  area’s  intrinsic  climatic  variability 
or  is  in  a  circumstance  where  it  is  not  possible  to  use  either  ground  instruments 
or  an  in-scene  inversion  algorithm,  determining  inherent  variability  in  one  or  more 
atmospheric  parameters  is  not  required  under  normal  conditions.  Thus,  it  does 
not  directly  add  value  to  any  particular  remote  sensing  activity,  but  it  provides  a 
starting  point  for  this  investigation.  The  results  of  the  atmospheric  profiling  provide 
default  values  for  each  of  the  three  atmospheric  error  terms  and  give  an  upper 
bound  on  reflectance  retrieval  errors.  The  process  for  collecting  the  required  data 
and  calculating  the  inherent  uncertainty  will  be  briefly  discussed. 
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4.9.2  Error  sources  from  ground  instruments 

The  basic  premise  of  this  work  is  that  whereas  ground  instruments  were  previ¬ 
ously  regarded  as  undesirable  in  operational  imaging,  recent  advances  in  wireless 
electronics  and  miniaturization  have  made  low-cost  networks  of  autonomous,  unat¬ 
tended,  and  remotely  placed  ground  sensors  feasible  and  worth  examining. 

Using  an  instrument  to  measure  either  an  atmospheric  parameter  or  one  of  the 
modeling  outputs  directly  produces  both  an  answer  and  a  measurement  uncertainty. 
This  estimation  of  measurement  error  comes  straight  from  a  basic  physics  class  les¬ 
son  in  lab  discipline  and  technique.  Each  instrument  is  calibrated  and  characterized 
individually,  and  the  uncertainty  is  generally  available  on  a  product  data  sheet. 

Although  the  actual  instruments  used  for  each  data  source  are  listed  elsewhere, 
it  will  be  assumed  that  the  reported  measurement  uncertainty  either  for  that  in¬ 
strument  or  that  class  of  instruments  is  what  one  can  reasonably  expect  to  observe 
when  incorporating  a  ground  instrument  into  a  sensing  network. 


4.9.3  Error  sources  from  inversion  algorithms 

Each  inversion  algorithm  must,  by  definition,  somehow  solve  equation  4.18.  The 
two  main  classes  of  inversion  algorithms,  ground  truth-based  and  model-based, 
each  obtain  the  terms  differently.  The  empirical  line  method,  the  prime  example 
of  the  first  type  determines  the  reflectance-to-digital  count  linear  conversion  factor, 
which  is  an  inseparable  combination  of  all  of  the  multiplicative  terms.  EEAASH, 
an  example  of  the  second  type,  obtains  each  of  the  modeling  outputs  as  described 
here  and  uses  them  to  solve  for  the  constants  A  and  B  in  equation  3.10. 

Error  in  EEM  is  not  considered  at  this  time  because  its  result,  the  linear  con¬ 
version  factor,  is  largely  incompatible  with  the  error  analysis  performed  in  this 
research.  It  will  be  examined  later  for  comparison  purposes,  but  there  is  no  mean¬ 
ingful  translation  of  error  in  one  of  the  terms  to  error  in  the  entire  combination  of 
terms  making  up  the  conversion  factor.  It  is  possible  to  imagine  hybridized  EEM 
algorithms  that  can  take  advantage  of  ground  methods  either  in  the  direct  result,  a 
portion  of  the  direct  result  (numerator  or  denominator),  or  in  the  spatial  propaga¬ 
tion  of  the  result.  However,  constructing  such  algorithms  is  beyond  the  scope  of 
this  work. 

A  useful  output  of  EEAASH  is  the  water  vapor  and  aerosol  abundance  maps 
it  produces.  However,  these  parameter  maps  are  not  accompanied  by  any  kind  of 
estimation  uncertainty. 
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4.10  Total  error  due  to  atmospheric  constituent  uncertainty 

In  the  terminology  used  here,  there  are  four  modeling  outputs:  sun-ground  trans¬ 
missivity,  ground-sensor  transmissivity,  downwelled  radiance,  and  upwelled  radi¬ 
ance.  Given  a  set  of  atmospheric  parameters,  the  radiative  transfer  code  MOD- 
TRAN  produces  these  as  results,  hence  the  terminology  “modeling  outputs.”  The 
errors  in  each  of  these  outputs-S,-! ,  Sr2,  Sl^,  and  SL^-are  key  terms  in  the  error 
propagation  model.  The  construction  of  these  error  terms  is  straightforward,  as  is 
illustrated  in  figure  4.8. 


Figure  4.8:  Construction  of  total  error  in  each  model  output 


Each  error  term  is  calculated  according  to  equations  A.20  through  A.23.  The 
partial  derivative  terms  are  the  MODTRAN  slopes  described  in  section  4.8  com¬ 
puted  numerically  for  each  imaging  scenario.  The  error  in  each  atmospheric  pa¬ 
rameter  is  derived  from  one  of  several  possible  ways,  as  described  in  section  4.9. 
The  result  of  this  calculation  is  a  single  multiplication  producing  one  value  per 
spectral  band  that  represents  the  root-sum-square  of  the  uncertainty  in  each  param¬ 
eter  with  the  sensitivity  of  each  modeling  output  to  a  change  in  parameter  value. 

4.11  Physical  models 

While  not  error  models  per  se,  these  factors  are  key  enablers  to  the  modeling 
process.  Terrain  altitude  is  a  required  input  for  radiative  transfer  modeling,  and 
exoatmospheric  solar  irradiance  is  a  term  found  directly  in  the  governing  equation. 
Uncertainty  in  both  will  affect  the  final  resulf,  so  error  modeling  mefhodology  for 
fhese  faclors  is  shown  here. 
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4.11.1  Elevation  knowledge 

Although  density  altitude  is  used  to  index  the  atmospherie  eolumn  density  to  a  sin¬ 
gle  ground-based  parameter,  terrain  elevation  knowledge  aeross  the  image  is  also 
required.  Geographie  survey  data  are  available  for  the  United  States,  but  the  reso¬ 
lution  may  be  insuffieient  to  be  useful  for  remote  sensing.  Loeal  digital  elevation 
models  (DEM)  may  also  be  available,  but  a  laek  of  universal  availability  would 
invalidate  some  of  the  assumptions  upon  whieh  the  overall  effort  rests.  An  in- 
ereasingly  eommon  method  is  through  GPS,  although  eare  must  be  given  to  ensure 
the  result  is  adjusted  to  the  eorreet  geodesie  referenee,  and  high  terrain  variability 
reduees  the  usefulness  of  a  handful  of  sensors  seattered  throughout  an  area.  Fortu¬ 
nately  there  is  at  least  one  dataset,  the  Shuttle  Radar  Topography  Mission  (SRTM), 
that  provides  global  eoverage  at  good  resolution  with  well-understood  aeeuraey 
(Rodriguez  et  al.,  2005).  DEM  data  ean  be  interpolated  to  any  point  in  an  image, 
as  is  shown  in  figure  4.9. 


(a)  2-dimensional  view  (b)  3-dimensional  view 


Figure  4.9:  DEM  interpolation  visualization 


Given  performanee  inputs  for  the  eireular  eoordinate  error  (whieh  is  evenly  de- 
eomposed  into  2D  orthographie  eoordinate  error)  and  z-height  measurement  error, 
it  is  simple  to  propagate  the  error  into  the  interpolated  eoordinate.  The  meehanies 
for  doing  so  are  ineluded  as  equation  A.29.  The  SRTM  performanee  speeifieations 
at  90%  eonfidenee  were  16  meters  for  z-height  error  and  20  meters  for  eireular 
error.  Typieal  performanee  was  eloser  to  5  meters  for  z-height  error  and  15  meters 
for  eireular  eoordinate  error  (Rodriguez  et  al.,  2005). 

Using  a  seenario  eoneept  to  establish  a  performanee  baseline,  the  SRTM  per- 
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formance  specs  were  used  as  worst  case  values  to  predict  the  error  in  interpolated 
altitude  across  the  DEM  grid.  Figure  4.10  shows  the  resulting  error  in  altitude 
given  flat  terrain  and  the  SRTM  performance  cited  above. 


DEM  altitude  error,  flat  terrain 


Figure  4.10:  DEM  altitude  error  using  SRTM  values  and  flat  terrain 


Because  linear  interpolation  assumes  a  defined  surface  of  some  sort  (4  points 
can  lead  to  a  curved  surface  rather  than  a  flat  plane),  each  DEM  point  samples  the 
same  geometry.  The  samples  are  essentially  added  in  quadrature,  providing  an  RSS 
result  that  is  a  minimum  when  the  samples  are  equidistant  (Soukup,  2008).  As  the 
point  of  interest  gets  closer  to  any  individual  sample  location,  the  error  increases 
to  a  local  maximum  corresponding  to  the  error  for  each  measurement.  Using  the 
values  cited  above,  the  altitude  uncertainty  ranges  between  4-9  meters.  For  non¬ 
flat,  non-planar  surfaces,  the  error  surface  is  skewed  towards  the  regions  of  higher 
slope. 

4.11.2  Exoatmospheric  solar  irradiance 

The  final  term  of  equation  4.20  to  be  considered  does  not  fall  into  any  of  the  previ¬ 
ous  categories.  Exoatmospheric  solar  irradiance  variability  will  be  fully  explored. 
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but  the  result  is  so  small  so  as  to  be  ealled  trivial,  even  in  this  analysis  where  errors 
are  not  lightly  east  aside. 

High-preeision  solar  ephemeris  data  is  publiely  available  (Giorgini  et  al.,  1996). 
The  instantaneous  earth-sun  distanee  is  mathematieally  predieted  to  within  10“® 
astronomieal  units  (AU),  where  the  mean  earth-sun  distanee  is  equivalent  to  1  AU. 
The  mean  exoatmospherie  solar  irradianee,  Eg,  is  also  published.  However,  the 
value  of  the  eonstant,  while  preeise,  is  anything  but  eonstant.  During  the  year,  the 
instantaneous  earth-sun  distanee  liuetuates  eyelieally  as  the  earth  revolves  around 
the  sun.  There  is  also  a  long  period  fluetuation  in  the  mean  irradianee  due  to  the 
sun’s  1 1  year  sunspot  eyele  (as  well  as  a  very  long  period  fluetuation  due  to  so¬ 
lar  fuel  depletion  and  long  term  sunspot  trends).  Finally,  there  is  day-to-day  and 
minute-to-minute  variability  in  the  solar  eonstant  due  to  sunspots,  fluid  eonvee- 
tion,  magnetie  effeets,  and  other  solar  aetivity  (Solanki  et  al.,  2005).  Thus,  both 
the  mean  irradianee  and  instantaneous  earth-sun  distanee  must  be  updated. 

Mueh  work  has  gone  into  modeling  the  eyelie  fluetuations  of  the  solar  irradi¬ 
anee  eonstant,  and  the  deeade-seale  periodie  fluetuation  of  the  mean  solar  eonstant 
ean  be  aeeurately  modeled  (Solanki  and  Krivova,  2004).  A  eurrent  mean  value  of 
1366.22FF/m^  with  a  maximum  error  of  0.1%  was  defined  as  the  Spaee  Absolute 
Radiation  Referenee  (SARR)  by  the  SOLCON  projeet  through  data  reduetion  of 
a  series  of  ongoing  spaeeborne  instrument  data  eolleetions  (Crommelynek  et  al., 
1995).  This  referenee  value  had  the  seeondary  effeet  of  providing  an  instrument 
eross-ealibration  that  ean  be  propagated  to  future  measurements.  The  eapability 
exists  to  measure  the  fluetuating  eonstant  with  a  95%  eonfidenee  interval  value  of 
±0.35VF/m^  (a  normal  distribution  is  assumed).  The  95%  eonfidenee  interval  of 
a  normal  distribution  eorresponds  to  1.96  standard  deviations,  so  the  value  of  1 
standard  deviation  ean  be  derived.  Assuming  a  simple  adjustment  of  the  form  in 
equation  4.50,  the  error  in  the  average  irradianee  is  ealeulated  as  shown  in  equation 
4.51.  The  errors  in  eaeh  eomponent  are  assumed  to  be  independent. 

Es^avg  =  ref  +  adj  (4.50) 


Si 

^s,avg 


q2  I  n2 
^ref  '  ^adj 

0.1%  X  1366.22 
^/V2 


(4.51) 


Beeause  instantaneous  exoatmospherie  solar  irradianee  follows  a  well-defined 
inverse  square  relationship,  it  is  an  easy  matter  to  both  determine  the  irradianee  and 
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calculate  its  error.  The  distance  correction  is  shown  in  equation  4.52  (Schott,  1997). 
Note  that  the  average  earth-sun  radius  Vavg  is  always  1  if  the  units  are  astronomical 
units,  in  which  case  the  instantaneous  earth-sun  distance  r  is  expressed  as  a  fraction 
of  1  AU.  A  noise  term  is  added  to  account  for  short-period  variations  in  the  solar 
constant.  These  were  measured  in  one  experiment  to  be  as  much  as  l.SVF/m^,  but 
it  was  generally  observed  to  be  about  a  third  less  than  that.  A  Gaussian  model  is 
assumed  for  these  random  variations  (Crommelynck  et  ah,  1995). 

y.2 

Eg  =  -^Eg^avg  +  noise  (4.52) 

^avg 

The  error  in  the  exoatmospheric  irradiance  is  obtained  by  applying  the  error 
propagation  equation,  yielding  equation  4.53.  In  this  instance,  the  actual  error 
value  is  predicted  in  equation  4.54  to  be  on  the  order  of  \.EW jvn} .  The  impli¬ 
cation  is  that  the  system  is  heavily  dominated  by  solar  “noise.”  Since  there  is  no 
possibility  of  using  a  less  noisy  celestial  body  in  the  calculation,  the  only  ways  to 
reduce  the  error  are  to  construct  a  more  complex  model  that  encompasses  daily 
solar  activity  or  measure  the  solar  constant  with  much  greater  frequency.  Neither 
of  these  approaches  is  feasible  in  the  foreseeable  future.  The  upside  of  this  is  that 
this  variation  is  extremely  tiny. 

Se^  =  {2rEg^avgl^-^?  +  (r20.43)2  +  I.52  (4.54) 

The  modeling  approach  for  determining  the  variability  due  to  exoatmospheric 
solar  irradiance  is  to  calculate  two  MODTRAN  runs,  each  using  a  value  for  solar 
constant  that  varies  on  the  order  of  the  solar  irradiance  uncertainty.  The  results 
would  then  be  compared.  However,  it  was  found  that  the  difference  in  the  two 
inputs  were  below  MODTRAN’s  ability  to  produce  distinct  output.  Using  a  larger 
step  size  and  normalizing  it  down  to  the  required  order  of  magnitude  produced  a 
variability  that  was  still  exceedingly  close  to  zero. 

4.12  Sensor  error  models 

As  described  in  section  4.3,  sensor-reaching  radiance  is  treated  in  a  possibly  counter¬ 
intuitive  way.  This  term  describes  the  radiance  after  it  has  suffered  all  of  the  atmo¬ 
spheric  effects  but  before  it  encounters  the  sensor.  However,  it  is  always  expressed 
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as  dependent  on  the  sensor’s  operation.  This  is  beeause  true  sensor-reaehing  radi- 
anee  is  an  unknowable  quantity.  Like  all  big  equation  terms,  it  must  be  measured 
with  an  instrument.  The  imaging  speetrometer  is  just  another  one  of  these  “truth” 
instruments,  exeept  it  is  speeialized  to  take  many  sequential  and/or  simultaneous 
data  points  registered  to  spatial  loeations. 

Generally  a  single  number  is  suffieient  to  deseribe  the  error  in  ground  truth 
instruments,  but  these  are  simpler  instruments  designed  to  read  out  perhaps  one 
or  two  transdueers.  With  an  imaging  speetrometer,  the  instrument’s  eomplexity  is 
sueh  that  a  eomprehensive  model  of  the  noise  inherent  in  several  different  eompo- 
nents  needs  to  be  built  before  this  final  result  ean  be  produeed.  The  error  sourees 
eonsidered  are  eategorized  by  radiometrie  ealibration  aeeuraey,  speetral  ealibra- 
tion  aeeuraey,  and  physieal  faetors  sueh  as  knowledge  of  the  platform’s  loeation 
and  orientation. 

4.12.1  Radiometric  calibration 

The  error  sourees  required  to  eonsider  radiometrie  ealibration  aeeuraey  are  pho¬ 
ton  noise,  eleetronie  shot  noise,  thermal  noise,  dark  eurrent,  and  hardware-indueed 
noise  sourees  sueh  as  eross-ehannel  eontamination  and  fixed-pattern  noise.  Pho¬ 
ton  noise  and  eleetronie  shot  noise  result  from  the  faet  that  both  light  and  eharge 
are  earried  by  diserete  quanta  that  travel  and  arrive  at  independent  random  rates. 
Thermal  noise  results  from  the  thermally-indueed  Brownian  motion  of  eleetrons. 
Dark  eurrent  is  any  signal  present  in  the  absenee  of  input  and  has  thermal  shot 
noise  as  its  main  eomponent.  It  ean  also  inelude  any  intentional  bias.  Pixel  eross- 
talk  results  when  eharge  in  one  deteetor  element  influenees  the  output  of  spatially 
proximate  pixels,  either  during  photon  eolleetion  or  during  readout.  Some  detee- 
tors  ean  also  have  various  amounts  of  hardware-indueed  noise,  many  of  whieh 
types  ean  be  designed  or  ealibrated  out  of  the  system.  Reset  noise  is  one  sueh 
souree,  whieh  oeeurs  when  there  is  variability  in  the  referenee  signal  against  whieh 
the  readout  is  measured.  Fixed  pattern  noise  is  another  eommon  example,  where 
variability  in  material  eomposition,  workmanship,  physieal  dimensions,  or  eleetri- 
eal  properties  (among  other  eharaeteristies)  eause  differenees  in  output  not  due  to 
signal  (Hewlett-Paekard  Components  Group,  1998). 

Produeing  a  eredible  model  of  a  sensor’s  ability  to  measure  sensor-reaehing 
radianee  is  a  eritieal  part  of  an  error  propagation  model.  While  there  are  inver¬ 
sion  algorithms  that  do  not  require  sensor-reaehing  radianee,  radianee  spaee  is  the 
chosen  common  framework  in  which  all  errors  are  cast.  Whether  or  not  digital 
counts  are  converted  to  radiance  in  a  specific  applicafion  does  nof  alfer  fhe  need  fo 
express  fhe  uncerfainfy  infroduced  by  fhe  defecfor  in  radiance  unifs.  This  permifs 
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the  comparison  of  sensor  hardware  to  the  other  sources  of  inversion  uncertainty. 

Although  there  are  typical  sources  and  magnitudes  of  hardware  noise  that  affect 
all  instruments,  there  is  no  model  that  can  adequately  capture  the  entire  range  of 
variability  and  still  be  useful  to  a  particular  sensor.  The  chosen  approach  is  to 
use  actual  results  from  one  or  more  instruments  that  can  be  considered  typical  or 
representative  of  the  state  of  the  industry.  The  error  propagation  model  will  use 
any  sensor  noise  model  expressed  in  noise  equivalent  change  in  radiance  (NEAL), 
which  is  the  resulting  radiance  fluctuation  that  corresponds  to  noise  fluctuations 
in  any  part  of  the  hardware  chain:  photon  flux,  charge  well  electrons,  voltage,  etc. 
This  output  metric  is  itself  a  common  framework  for  expressing  noise  derived  from 
potentially  very  different  hardware  configurations. 

Signal-to-noise  ratio  (SNR)  can  also  be  used  for  expressing  the  noise.  Because 
some  noise  regimes  are  tied  to  signal  level,  and  the  model  is  agnostic  as  to  which 
noise  regime  is  dominant,  it  is  a  general  guideline  that  the  SNR  or  neAL  should 
be  derived  from  signal  levels  on  the  same  order  of  magnitude  as  those  encountered 
when  conducting  normal  image  collection  operations.  Because  this  guideline  reads 
like  it  came  from  an  instruction  manual,  it  is  appropriate  to  recall  the  proper  pur¬ 
pose  of  the  error  propagation  model.  The  model  is  a  testbed  with  which  system 
behaviors  can  be  explored  and  conclusions  can  be  made  regarding  the  sources  and 
impacts  of  errors  given  particular  configurations.  It  is  not  intended  to  be  an  applica¬ 
tion  suitable  for  users  to  predict  the  performance  of  a  particular  sensor  in  a  specific 
sensing  configuration.  The  practical  difference  can  be  subtle,  but  it  is  the  primary 
reason  for  ignoring  the  sensor’s  spectral  convolution  model  and  interpolating  the 
given  data  to  the  spectral  range  and  resolution  chosen  for  the  model  at  the  top  level 
specification. 

For  the  purposes  of  running  the  error  propagation  model,  published  sensor  ra¬ 
diometric  calibration  data  for  typical-of-the-field  instruments  were  used  to  provide 
the  uncertainty  in  sensor-reaching  radiance.  Radiometric  bias  will  be  assumed  to 
driven  to  zero.  The  spectrometers  chosen  are  AVIRIS  (Vane,  1987),  HYDICE 
(Mitchell,  1995),  and  Hyperion  (Browne,  1999). 

4.12.2  Spectral  calibration 

Spectral  registration  refers  to  the  difference  between  the  spectral  band  model  and 
the  actual  band  widths  and  centers.  Each  sensor’s  band  model  consists  of  a  list 
of  band  centers,  widths,  and  response  curves.  When  a  band  is  reported  to  be  AA 
nm  wide  centered  on  wavelength  Aq,  a  width  or  centering  error  introduces  an  er¬ 
ror  into  the  resulting  spectrum.  The  amount  of  spectral  misregistration  may  or 
may  not  be  thought  of  as  a  random  variable,  depending  on  whether  it  is  a  fixed 
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or  random  difference.  Spectral  misregistration  is  normally  thought  of  as  a  fixed 
phenomenon,  though  Nischan  et  al.  (1999)  describes  random  spectral  jitter  effects 
in  the  HYDICE  sensor. 

Figure  4.11  shows  examples  for  these  effects.  In  figure  4.11(a),  a  simple  bias 
in  band  cenfer  produces  a  shift  in  radiance  ALsr.  The  lower  radiance  assigned 
to  that  band  would  affect  band  ratios  and  any  spectral  products  dependent  on  the 
retrieved  reflectance,  such  as  classification  or  abundances.  The  shift  in  radiance 
represents  a  bias  that  can  be  propagated  forward  into  reflectance  space. 


Wavelength  (nm) 


(a)  Spectral  misregistration  example 


(b)  Spectral  jitter  example 


Figure  4. 1 1 :  Illustration  of  spectral  calibration  errors  and  their  effects  on  the  imag¬ 
ing  chain 


In  figure  4. 1 1(b),  a  baseline  band  cenfer  is  subjecf  to  random  variation.  The  fre¬ 
quency  of  each  perturbed  spectrum  is  given  by  a  probability  distribution  governing 
the  amount  of  spectral  jitter.  The  result  of  this  random  variation  in  band  center  is  to 
produce  a  range  of  radiances  assigned  to  that  band.  The  parameter  a^sr  is  intended 
to  denote  the  standard  deviation  of  the  resulting  distribution.  The  expected  value  of 
the  radiance  should  more  or  less  match  the  baseline  result,  but  the  variance  in  the 
radiance  now  represents  an  uncertainty  in  sensor  radiance  that  can  be  propagated 
into  reflectance  space. 

The  degree  of  change  in  radiance  due  to  a  change  in  any  of  these  parameters 
is  highly  context  dependent.  For  a  perfectly  flat  spectrum,  a  shift  in  band  center 
would  have  no  effect,  whereas  an  error  in  the  band  width  would  produce  a  lin¬ 
ear  increase  or  decrease  in  integrated  radiance.  For  a  highly  variable  spectrum, 
changing  the  center  of  the  spectrum  has  a  significant  effect  on  the  output  for  that 
band.  A  defect  in  the  band  widths  would  show  the  same  increase  or  decrease  in 
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integrated  radianee,  though  the  ehange  amount  is  not  as  predietable.  The  relevant 
faetors  are  band  eenter,  band  width,  target  refleetanee,  and  atmospherie  eonditions, 
whieh  produee  the  absorption  bands  that  tend  to  dominate  the  speetral  shape. 

The  governing  equation  for  speetral  response  funetion  and  signal  speetrum  in- 
teraetion  is  shown  in  equation  4.55.  The  funetion  (A)  is  the  speetral  flux  ineident 
on  the  deteetor.  The  speetral  response  funetion  for  band  i  of  n  bands,  annotated 
as  (A),  is  generally  modeled  as  Gaussian,  supergaussian  (the  exponent  on  the 
independent  variable  is  an  integer  greater  than  2,  yielding  a  flatter  top),  reetangu- 
lar,  trapezoidal,  or  triangular  in  shape.  Gaussian  response  funetions  are  used  for  all 
modeling  in  this  work. 

Although  the  left-hand  term  in  equation  4.55  is  traditionally  signal  (Si),  eal- 
ibrated  sensor  radianee  for  band  i  (Li)  will  be  used  to  avoid  terminology  eonfu- 
sion.  S  is  used  elsewhere  to  denote  sample  standard  deviation,  and  the  differenee 
between  signal  and  radianee  is  the  radiometrie  ealibration,  whieh  is  momentarily 
held  eonstant  for  the  purposes  of  this  diseussion. 

roo 

Li=  /  ^(\)Ri(\)d\  (4.55) 
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Assuming  a  Gaussian  form  for  the  moment,  the  equation  ean  be  rewritten  as 
shown  in  equation  4.56.  When  a  shift  error  S\q  and  width  error  Sax  are  present, 
the  error  in  the  resulting  signal  ean  be  expressed  by  equation  4.57. 
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The  ultimate  goal  is  a  model  that  ean  produee  the  sensitivity  of  sensor-reaehing 
radianee  to  errors  in  band  eenter  and/or  band  width.  A  speetral  ealibration  error 
simulation  was  performed  by  Green  (1995),  whose  result  for  a  100%  refleetor  is 
reprodueed  in  figure  4.12.  The  eonelusion  was  that  speetral  ealibration  to  within 
0. 1-0.5  nm  was  required  to  prevent  speetral  effeets  from  dominating  the  instrument 
error. 

The  strong  dependenee  of  perturbed  radianee  on  eaeh  variable  will  be  demon¬ 
strated.  As  is  seen  in  figure  4.12,  speetral  ealibration  errors  are  most  apparent 
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Figure  4.12:  Percent  error  in  radiance  as  a  function  of  band  center  shift 


in  the  typical  water  vapor,  carbon  dioxide,  and  oxygen  atmospheric  absorption 
bands,  where  the  absorption  features  create  strong  slopes.  However,  many  target 
reflectance  spectra  have  strong  features  as  well.  Equation  4.57  is  unworkable  when 
constructing  a  rigorous  model  because  the  solution  depends  on  not  only  the  spectral 
response  function,  but  also  the  shape  of  the  reflectance  curve  being  sampled. 

In  cases  where  atmospheric  transmission  curves  produce  steeper  slopes  than 
spectral  reflectance  curves,  generalizations  can  be  made  that  apply  to  a  wide  range 
of  possible  targets.  To  this  end,  seven  representative  reflectance  spectra,  shown  in 
figure  4.13,  were  simulated  along  with  3  spectrally  uniform  reflectors:  a  100%, 
a  50%,  and  an  18%  reflector.  The  sample  ground  cover  targets  include  asphalt, 
concrete,  grass,  dirt,  deciduous  vegetation,  painted  steel,  and  two  linear  mixtures 
of  some  of  these  common  classes. 

Although  several  of  the  curves  exhibit  strong  slope  features,  the  features  in  the 
sensor-reaching  radiance  spectra  are  largely  (but  not  wholly)  ahributable  to  atmo¬ 
spheric  absorption.  This  claim  is  supported  by  inspection  of  the  radiance  curves  for 
the  chosen  ground  cover  targets,  shown  in  figure  4.14.  It  is  magnitude,  not  spec¬ 
tral  features,  that  is  the  prime  determiner  of  how  spectral  calibration  errors  will 
manifest,  though  the  “red  edge”  present  in  several  of  the  target  reflectance  spectra 
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Figure  4.13:  Reflectance  curves  used  to  simulate  spectral  cal  errors 


serves  as  a  prominent  exception.  This  feature  is  strong  enough  to  co-dominate,  yet 
atmospheric  effects  still  appear  prominent  in  the  results  of  the  original  simulation 
in  figure  4. 12.  The  conclusion  is  that  strong  spectral  features  can  induce  error  in  re¬ 
trieved  reflectance,  but  significant  error  will  exist  anyway  for  any  target  because  of 
the  atmosphere  and  overall  target  brightness.  This  error  concentrates  near  the  var¬ 
ious  atmospheric  absorption  features,  which  are  spectrally  invariant  (though  their 
width  may  change  with  atmospheric  composition). 

A  simulation  was  conducted  using  a  notional  band  model,  a  ±2  nm  shift  in 
band  center,  and  the  ground  cover  targets  presented  in  figure  4.13.  The  band  model 
uses  21 1  bands,  ranging  between  400  and  2500  nm  on  10  nm  centers  and  Gaussian 
response  curves,  with  10  nm  between  50%  response  points  (full-width  half-max, 
or  FWHM).  Results  for  the  band  center  shift  study  are  shown  in  section  5.4. 

4.12.3  Ground  radiometer 

A  dual-input  ground  radiometer  is  a  sensor  configuration  meriting  individual  at¬ 
tention.  A  dual-mode  reflectometer  measures  both  the  ground-reaching  irradiance 
and  the  ground-leaving  radiance.  It  can  determine  the  target  reflectance  despite 
frequent  time-domain  changes  in  the  radiance  environment  because  the  two  inputs 
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Figure  4.14:  Radiance  curves  used  to  simulate  spectral  cal  errors.  The  black  curves 
represent  results  for  a  100%,  a  50%,  and  an  18%  reflector.  The  colored  curves 
correspond  to  results  for  each  of  the  7  target  types  shown  in  figure  4.13. 


sense  the  same  illumination  at  all  times.  A  notional  illustration  of  this  configura¬ 
tion  is  shown  in  figure  4.15.  In  the  figure,  one  input  head  points  towards  a  target 
to  measure  ground-leaving  radiance.  The  other  points  straight  up  with  a  cosine 
head  attachment  (depicted  as  a  hemispherical  diffuser,  though  they  are  also  flat)  to 
measure  total  irradiance. 

A  simple  derivation  of  ground  instrument  error  is  provided  for  this  case  so  that 
it  these  types  of  ground  instruments  can  be  incorporated  into  the  error  propagation 
model  to  study  error  reduction  scenarios.  Other  than  the  geometric  configuration 
allowing  a  reduction  in  mathematical  complexity,  the  error  considerations  for  these 
sensors  is  the  same  as  for  the  instruments  described  above.  The  irradiance  head 
measures  total  irradiance  as  shown  in  equation  4.58.  The  other  head  measures  the 
same  energy  as  radiance  after  it  is  reflected  off  the  ground  target.  This  is  shown 
in  equation  4.59,  where  E  indicates  spectral  irradiance  in  units  of  W/m?,  M  is 
spectral  exitance  in  the  same  units,  and  the  G  subscript  indicates  energy  incident  to 
or  leaving  the  ground.  The  signals  from  each  head  are  indicated  by  vi  and  V2-  The 
ratio  of  these  signals  can  be  used  to  determine  the  target’s  Lambertian  reflectance 
per  equation  4.60. 
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Figure  4.15:  Ground  reflectometer  in  dual-input  configuration 


v\  =  Eg  =  EsT\  -h 


f27r 


/o  do 


Ld,  (cr,  4>)  cos  a  sin  adadcj. 


Mg  Eg 

V2  =  Eg  = - =  r — 

TT  TT 


(4.58) 

(4.59) 


_  V2Tr 

Vl 


(4.60) 


The  error  analysis  is  applied  in  the  usual  manner,  as  seen  in  equation  4.61. 
Although  both  radiometer  heads  are  assumed  to  have  the  same  instrument  noise,  it 
is  necessary  to  use  equation  4.59  to  convert  one  measurement  into  the  units  of  the 
other. 


(4.61) 
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If  instrument  noise  is  reported  as  a  speetrally  flat  pereentage  of  the  signal,  a 
further  simplifieation  is  possible.  If  the  noise  faetor  is  k,  where  k  would  be  0.03 
for  an  example  noise  level  that  is  3%  of  the  signal,  then  equation  4.62  shows  the 
final  form.  In  reality,  just  as  for  imaging  speetrometers,  speetral  noise  response  for 
field  instruments  is  not  flat,  though  some  report  the  eonstant  faetor  merely  as  an 
upper  bound  for  the  noise. 


Sr  =  V2kr 


(4.62) 


4.12.4  Mechanical  factors 

Knowledge  of  the  sensing  platform’s  physieal  environment  is  an  obligatory  pieee 
of  the  remote  sensing  equation.  Eaeh  pieee  of  information  is  measured  with  one  or 
more  truth  instruments  and  stored  along  with  the  image  as  engineering,  navigation, 
or  other  metadata.  The  quantities  inelude  inertial  position,  airspeed,  roll,  piteh, 
heading,  time,  temperature,  pressure,  and  altitude.  Instrument,  lamp,  blaek  body, 
and  sean  motor  voltages  and/or  temperatures  may  also  be  reeorded  as  applieable. 
Each  piece  of  metadata  indirectly  affects  the  final  reflectance  solution,  and  each 
reading  has  an  uncertainty  attached. 

The  main  effect  of  physical  factors  is  to  change  the  pixel  location  and  size 
relative  to  its  assumed  position  on  the  ground.  This  is  the  case  with  roll,  pitch, 
heading,  altitude,  and  absolute  location.  However,  the  error  caused  by  imaging 
the  wrong  spot  on  the  ground  is  something  the  error  propagation  model  was  not 
designed  to  handle.  Even  if  a  radiometric  signature  is  indexed  to  the  wrong  ground 
spot,  it  can  still  be  accurately  inverted  to  reflectance. 

These  same  factors  can  also  affect  how  the  radiometric  signature  is  inverted, 
primarily  by  changing  the  assumed  path  length.  They  are  usually  ignored  because 
the  differences  are  small-on  the  order  of  3  degrees  or  less  for  the  angles  and  tens 
of  meters  in  altitude  (Clark  et  ah,  1998).  Then,  if  they  are  included,  errors  in 
knowledge  of  these  parameters  amount  to  an  even  smaller  effect. 

A  similar  situation  exists  with  voltage  stability  of  the  calibration  standards  and 
scan  hardware  (if  applicable).  Whereas  small  voltage  variations  can  cause  slight 
differences  in  the  performance  of  these  components,  they  can  be  compensated  for 
down  to  the  level  where  the  voltage  stability  introduces  random  error  that  cannot 
be  compensated  for,  but  this  error  is  extremely  tiny. 

As  a  result,  uncertainty  in  knowledge  of  physical  factors  are  mostly  excluded 
from  rigorous  propagation  under  the  assumption  that  their  effects  reside  at  a  level 
or  two  below  the  detail  level  included  in  the  rest  of  the  model.  There  does  exist 
a  capability  to  specify  random  error  in  pointing  angle,  whether  it  arises  from  a 
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stabilized  platform  or  control  of  a  rotating  mirror.  Even  so,  with  errors  possibly 
on  the  order  of  1  ^urad  for  the  stabilized  platform  or  1  mrad  for  the  direct  pointing, 
even  this  error  source  was  found  to  be  extremely  small  when  placed  in  the  larger 
context  of  inversion  to  reflectance. 

4.13  Environmental  error  models 

Environmental  errors  are  parts  of  the  imaging  chain  whose  sources  cannot  be  mod¬ 
eled  mathematically.  The  factors  referred  to  here  are  target  tilt  relative  to  the  local 
terrestrial  normal,  off-nadir  sensor  pointing,  clouds,  and  background  objects.  Their 
effects  are  part  of  the  governing  equations,  but  the  variables  themselves  are  not  pre¬ 
dictable;  they  are  organic  parts  of  the  imaging  environment.  This  has  two  critical 
implications: 

1 .  The  error  is  not  reasonably  bounded 

2.  To  be  fully  accounted  for,  the  physical  quantity  must  be  measured  at  every 
spatial  location  in  the  image,  or  else  there  will  be  a  guaranteed  error 

The  first  assertion  refers  to  the  fact  that  an  environment  variable  can  take  on 
any  value  within  a  certain  range,  with  the  resulting  change  in  apparent  reflectance 
taking  on  values  anywhere  from  0  to  100%  or  more.  This  theoretical  freedom  is 
restricted  in  practice  by  behavioral  tendencies  either  in  the  variables  themselves  or 
by  how  imaging  is  accomplished,  and  this  alone  salvages  the  situation.  The  second 
assertion  points  to  the  fact  that  statistical  models  are  ill-suited  for  predicting  the 
variability  of  an  environmental  term  because  their  variability  does  not  obey  a  ran¬ 
dom  probability  distribution.  Hence,  spatial  propagation  techniques  can  propagate 
the  uncertainty  but  not  the  values  themselves. 

Eurthermore,  this  failure  to  account  for  these  types  of  effects  introduces  a  new 
category  of  error:  systematic  bias.  Assuming  a  term  is  not  present  when  it  is  creates 
a  direct  bias  that  is  mathematically  carried  along  as  a  separate  term,  and  systematic 
bias  terms  are  not  incorporated  into  the  partial  derivative  method  of  computing  ran¬ 
dom  error.  Although  imperfect  knowledge  of  the  term  does  increase  the  amount 
of  random  error,  leaving  it  out  completely  does  not  affect  the  random  error.  An 
intuitive  example  of  this  is  taking  a  series  of  measurements  with  a  ruler.  The  mea¬ 
surements  themselves  will  vary  according  to  some  random  measurement  error,  but 
if  the  ruler  has  an  inch  of  wood  sawed  off  the  back  end,  all  of  the  measurements 
are  biased  in  a  deterministic  way.  Whereas  random  error  is  denoted  as  5,  a  A  is 
used  to  indicate  a  systematic  or  non-random  bias.  Equation  4.63  recalls  the  basic 
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expression  of  this  fact  for  reflectance.  The  variable  r  represents  the  true  value, 
and  the  variable  r  represents  the  imperfect  estimate.  Keeping  with  this  convention, 
variables  with  the  hat  are  also  imperfect  estimates  or,  in  this  case,  values  that  do 
not  fully  account  for  one  of  the  environmental  effects. 

Ar  =  r  —  r  (4.63) 

These  concepts  will  now  be  discussed  in  the  context  of  each  environmental 
term,  and  the  methodology  by  which  each  was  modeled  is  presented.  The  final 
forms  for  reflectance  bias  were  previously  presented  in  section  4.6.4.  What  follows 
is  a  discussion  of  how  the  component  terms  were  actually  determined. 

4.13.1  Target  tilt 

The  target  tilt  is  part  of  the  variable  a^/,  the  solar  zenith  angle  from  the  target 
plane’s  frame  of  reference.  Figure  4.16  shows  the  angular  relationships  between 
the  solar  zenith  angle  as  and  the  local  solar  incidence  angle  a'g-  The  model  for  bias 
error  resulting  from  assuming  the  target  plane  is  the  same  as  the  local  tangent  plane 
is  given  in  equation  4.40.  The  change  in  direct  solar  irradiance  is  simple  to  adjust 
for,  but  the  model  does  not  automatically  adjust  the  diffuse  radiance  for  the  loss 
of  downwelled  sky  radiance  and  the  addition  of  terrain-based  background  radiance 
(however,  the  model  allows  this  to  be  set  manually).  It  is  also  assumed  that  the  tilt 
is  low  enough  such  that  the  target  is  not  placed  into  shadow. 


Figure  4.16:  Tilted  target  relative  to  the  local  horizon 
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The  tilt  of  the  local  normal  can  range  from  0-90°,  which  in  turn  can  cause  the 
apparent  reflectance  to  range  from  0  to  over  100%  of  its  actual  value.  This  is  miti¬ 
gated  by  the  fact  that  terrain  normally  does  not  contain  sharp  inclines,  but  there  is 
no  reason  why  this  could  not  be  the  case.  Geologic  and  human  features  both  cause 
spatial  discontinuities  statistical  models  are  powerless  to  predict.  Additionally,  the 
process  of  building  a  statistical  model  strong  enough  to  adequately  describe  an  area 
produces  the  kind  of  full-scene  data  set  required  by  the  second  assertion.  The  sta¬ 
tistical  model  must  adequately  capture  not  just  the  altitude  variability,  but  also  the 
angle  variability,  and  they  two  are  very  different  things. 

A  simple  terrain  scenario,  shown  in  figure  4.17,  was  constructed  to  illustrate 
a  limitation  of  elevation  measurement  with  respect  to  sample  spacing.  It  shows  a 
piece  of  terrain  in  which  a  hill  causes  a  10  meter  change  in  elevation  over  a  20 
meter  distance  (a  26°  incline).  The  terrain  is  sampled  at  30  meter  intervals,  which 
corresponds  to  an  SRTM  product. 


0  10  20  30  40  50  60 

Relative  ground  distance  (m) 


Figure  4.17:  Elevation  measurement  scenario 


In  this  simple  demonstration,  the  elevation  and  angular  deviations  are  com¬ 
puted  and  presented.  Linear  interpolation  is  performed  between  the  sample  loca¬ 
tions  to  produce  an  assumed  elevation  for  each  point  in  between.  The  local  terrain 
angle  is  also  calculated  for  each  point.  The  differences  are  presented  in  figures  4.18 
and  4.19.  Using  the  numbers  from  the  example,  the  elevation  is  never  more  than  5 
meters  away  from  the  true  value. 
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Relative  ground  distance  (m) 

Figure  4.18:  DEM  interpolation  error  in  elevation 
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Figure  4.19:  DEM  interpolation  error  in  direct  solar  term 
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When  using  the  altitude  as  an  input  to  atmospherie  modeling,  the  DEM  un- 
eertainty  is  far  below  the  uneertainty  attributable  from  other  sourees  (as  will  later 
be  shown),  showing  the  DEM’s  suffieieney  for  that  purpose.  However,  the  angu¬ 
lar  differenees  are  more  pronouneed.  The  ratio  of  the  eosines  of  both  angles  was 
taken  to  show  how  the  ehanges  in  angle  would  affeet  the  direet  solar  irradianee 
term  where  the  eosine  of  the  tilt  angle  plays  a  part. 

Even  though  the  DEM  sampling  is  never  more  than  15  meters  away  from  a 
ehange  in  terrain  elevation,  ineluding  one  sample  point  direetly  on  the  ineline, 
there  is  still  a  great  deal  of  error  in  the  tilt  angle.  The  sample  point  that  falls  di¬ 
reetly  on  the  slope  is  also  the  region  with  the  highest  angular  error,  whieh  was  a 
12%  differenee  in  the  eosine  term.  Using  equation  4.40,  this  translates  to  between 
roughly  4%  and  8%  refleetanee  error  depending  on  speetral  band.  Sinee  blind  us¬ 
age  of  DEMs  has  been  invalidated,  there  is  little  reeourse  with  respeet  to  predieting 
the  terrain  angle.  The  error  propagation  model  aeeommodates  tilt  angle  errors  in 
two  ways.  Eirst,  it  provides  a  gross  bias  error  estimate  based  on  the  assumption  that 
the  tilt  angle  is  0°.  When  the  seenario  speeifies  an  aetual  tilt  of  0°,  the  bias  error  is 
also  zero.  When  the  target’s  true  tilt  angle  is  non-zero,  this  error  term  is  permitted 
to  grow.  Seeondly,  an  input  is  provided  to  speeify  tilt  angle  knowledge  error.  The 
model  is  agnostie  as  to  the  souree  of  the  knowledge  error:  it  may  be  due  to  sim¬ 
ple  measurement  error  or  something  more  eomplex,  sueh  as  a  study  attempting  to 
statistieally  parameterize  angle  error  as  a  funetion  of  DEM  resolution  and  terrain 
variability.  While  physieal-world  drivers  of  tilt  angle  error  are  not  handled,  the 
error  souree  itself  ean  be  given  speeifieation  values  to  eompare  with  other  sourees 
and  provide  a  threshold  at  whieh  this  souree  beeomes  dominant. 

4.13.2  Clouds 

Clouds  are  a  diffieult  subjeet  to  treat.  Their  spatial  positions  and  frequeney  are  not 
predietable,  they  eome  in  several  different  varieties,  and  sometimes  ehange  faster 
than  they  ean  be  measured.  Their  abundanee  frequently  runs  the  full  range  from 
elear  sky  to  full  eoverage,  eliminating  direet  solar  irradianee  and  possibly  greatly 
redueing  diffuse  sky  radianee.  Alternately,  they  ean  inerease  the  radianee  of  some 
speetral  bands.  Unpublished  empirieal  data  suggest  that  elouds  that  graze  direet  so¬ 
lar  rays  may  even  inerease  the  total  irradianee  above  100%  of  the  sun’s  irradianee. 
Airport  observations  provide  pereent  eover,  layer  thiekness,  and  altitudes,  but  no 
positional  information.  It  is  possible  to  visually  estimate  eloud  position,  but  not  in 
a  way  that  produees  radiometrie  aeeuraey.  It  has  also  been  shown  empirieally  that 
elouds  ean  eause  extraordinary  spatial  variability  in  ground-reaehing  radianee  over 
distanees  on  the  order  of  1  km  or  less  (Klempner  et  ah,  2006).  Beeause  elouds  have 
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a  potentially  drastic  effect  on  the  results  and  their  temporal  and  spatial  variability 
make  them  extremely  difficult  to  model,  measure,  or  predict,  it  can  be  safely  said 
that  clouds  truly  are  the  bane  of  remote  sensing  in  the  visible  and  near  infrared 
spectrum. 

Clear  days  are  sometimes  called  “good  remote  sensing  days,”  and  cloudy  days 
are  not.  The  fact  that  an  overcast  sky  eliminates  direct  solar  irradiance  is  coun¬ 
terbalanced  by  the  fact  that  data  collects  for  radiometry  are  never  carried  out  on 
overcast  days.  Regardless,  the  factors  described  above  make  clouds  not  only  hard 
to  compensate  for  in  imaging,  but  they  also  greatly  complicate  the  modeling  pro¬ 
cess.  The  modeling  approach  here  will  be  approximate  in  the  hope  that  it  can  at 
least  provide  representative  results  and  act  as  a  guidepost  for  future  modeling  re¬ 
search.  It  may  be  possible  in  the  future  to  parameterize  cloud  characteristics  to 
radiance  variability,  but  it  is  currently  not  possible.  A  very  narrow  subset  of  the 
wide  range  of  cloud  conditions  will  be  modeled  using  a  numerical  approach  pub¬ 
lished  by  Fairbanks  (1999)  and  extended  by  Bartlett  (2006). 

Cloud  type  selection 

Four  different  types  of  cloud  conditions  are  illustrated  in  figure  4.20.  The  firsf 
(figure  4.20(a))  is  a  monolifhic  slab  of  infinile  horizonfal  dimension  simulafing 
an  overcasf  day.  This  is  fhe  fype  of  cloud  MODTRAN  uses.  Because  fhe  code 
is  geared  towards  calculating  fhe  radiance  onfo  a  single  poinf  rafher  fhan  a  3- 
dimensonal  scene,  fhis  is  fhe  mosf  appropriafe  fype  of  cloud  for  if  fo  use.  The 
facl  fhaf  fhe  code  calculafes  radiance  coming  from  fhe  entire  3-dimensional  hemi¬ 
sphere  may  make  Ibis  facl  lo  be  counlerinfuilive.  Regardless,  fhe  user  can  specify 
fhe  allifude,  Ihickness,  and  composilion  of  fhe  cloud  layer;  MODTRAN  does  fhe 
resf.  The  ofher  end  of  fhe  realism  specfrum  is  shown  in  figure  4.20(b).  Clouds 
are  3 -dimensional  objecfs  floating  in  air.  They  receive  radiance  direcfly  from  fhe 
sun  af  a  slanf  angle,  diffuse  sky  radiance,  and  reflecled  radiance  from  fhe  ground 
underneafh.  The  radiance  is  absorbed,  scalfered,  and  reflected  in  all  direcfions.  De¬ 
pending  on  fhe  angle  lo  fhe  viewer,  radiance  leaving  fhe  cloud  may  be  transmitted 
solar  radiance  or  reflected  sky  radiance,  or  a  combination  of  both.  Finally,  clouds 
can  have  “texture,”  meaning  they  have  fine  spatial  structure  that  has  both  high¬ 
lights  and  shadows.  The  wide  domain  of  cloud  types  led  to  the  decision  to  pare  the 
field  down  to  cumulus,  stratus,  and  altostratus  clouds.  For  each  type,  dark  (figure 
4.20(c))  and  bright  (4.20(d))  variants  were  created  to  simulate  the  highlights  and 
shadows  that  result  from  direct  and  indirect  solar  illumination  as  well  as  absorp¬ 
tion  or  transmission  through  the  cloud  itself.  This  gives  a  hare-bones  toolset  to 
start  building  cloudy  skies. 
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(a)  The  “MODTRAN  cloud” 


(b)  Realistic  cloud  modeling 


(c)  Dark  clouds 


(d)  Bright  clouds 


Figure  4.20:  Cloud  concepts 
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Cloud  modeling  approach 

Although  it  seems  primitive,  the  “MODTRAN  eloud”  is  enough  to  provide  basie 
radiometry  information  needed  to  model  eloud  variability.  The  sky  is  divided  up 
into  equiangular  quads  defined  by  azimuth  and  zenith  angles.  For  eaeh  azimuth 
and  zenith  angle  eombination  a  MODTRAN  run  is  generated  where  the  sensor 
view  angle  is  defined  by  the  azimuth  and  zenith.  For  dark  elouds,  the  sensor  looks 
from  underneath  the  eloud  deek  looking  up.  For  bright  elouds,  the  sensor  is  plaeed 
above  the  eloud  deek  looking  down.  From  the  run  the  total  sky  (direet  and  diffuse) 
radianee  from  that  partieular  direetion  is  saved  into  a  database.  Global  simulation 
seenario  settings  determine  the  speetral  bin  sampling,  time  of  day,  and  time  of  year, 
so  the  resulting  speetrum  database  is  portable  to  different  azimuths  but  not  different 
zenith  angles.  An  “endeap”  for  eaeh  hemisphere  is  used  to  simulate  the  radianee 
directly  overhead. 

Two  quad  division  schemes  were  used.  The  low  resolution  quad  database  uses  6 
zenith  positions,  12  azimuth  positions,  and  a  15°  endeap  for  a  total  of  72  quads.  The 
high  resolution  quad  database  uses  17  zenith  positions,  72  azimuth  positions,  and 
a  5°  endeap  for  a  total  of  1224  quads.  Figure  4.21  shows  the  populated  clear-sky 
databases.  The  brightest  spot  in  each  figure  corresponds  to  the  sun’s  location,  and 
the  brightness  of  each  quad  represents  the  scaled  panchromatic  radiance.  Figures 
4.21(c)  and  4.21(d)  show  a  two  dimensional  representation  of  the  quad  map.  Radial 
distance  from  the  center  represents  zenith  angle  ranging  from  0°  in  the  center  to 
90°  at  the  edge.  Azimuth  angle  is  represented  by  the  angular  distance  around  the 
circle,  with  0°  aligned  with  the  +x-axis.  Figures  4.21(a)  and  4.21(b)  show  the  same 
information  in  vertical  relief  to  show  the  relative  contribution  of  quads  close  to  and 
far  away  from  the  sun.  The  last  pair  of  figures,  4.21(e)  and  4.21(f),  present  the 
most  intuitive  view,  where  each  quad  is  spatially  placed  relative  to  an  observer  or 
target  in  the  center.  In  all  cases,  the  endeap  circle  is  clearly  visible.  The  simulation 
results  also  agree  with  similar  results  presented  elsewhere  (Schott,  1997). 

To  model  a  desired  sky  configuration,  quads  are  turned  “on”  or  “off”  in  a  simple 
configuration  array.  An  integer  number  for  each  position  tells  the  sky  builder  code 
to  use  clear  sky,  a  dark  cloud,  a  bright  cloud,  or  nothing  at  all.  This  interface 
is  highly  extensible  and  lends  itself  well  to  other  applications,  such  as  automated 
modeling  of  sky  hemisphere  photos  that  have  been  processed  into  cloud  maps  and 
thresholded.  The  sky  builder  then  calculates  the  downwelled  radiance.  The  basic 
expression  for  downwelled  irradiance  is  given  as  equation  4.64,  where  radiance  L 
from  any  direction  in  a  clear  sky  is  a  function  of  the  scattering  phase  function  and 
the  angles.  The  function  L  (a,  (p)  is  shown  in  figures  4.21(a)  and  4.21(b),  with  the 
angles  (p  and  a  coming  from  the  spatial  positions  of  each  point. 
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Sky  radiance  by  angular  position 


Sky  radiance  by  angular  position 
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(a)  72  quads 


(b)  1224  quads 


(c)  72  quads,  2D 


(d)  1224  quads,  2D 


(e)  72  quads,  hemisphere  (f)  1224  quads,  hemisphere 

Figure  4.21:  Clear-sky  radiance  results  for  72  and  1224  quads 
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Ed  =  L  (cj,  (p)  cos  adD  =  /  L{a,(p)  cos  a  sin  adcpda  (4.64) 

J  J  ^=0  j  (7=0 

The  discrete  approximation  form  of  equation  4.64  is  shown  in  equation  4.65. 
The  terms  on  the  right  replace  the  differential  terms  of  the  earlier  form  and  repre¬ 
sent  degrees  per  quad  in  both  the  azimuth  and  zenith  directions:  ritj,  is  the  number 
of  azimuthal  quads,  is  the  number  of  zenith  quads,  and  endcap  is  the  angular  di¬ 
ameter  of  the  endcap  portion  of  the  hemisphere.  The  expression  is  straightforward 
to  calculate. 


Ld 


TT 


2  n-a 

—  ^  ^  L{(j)i,aj)  cos  aj  sin  aj 

^  i=0  j=0 


TT  —  endcap'^ 


2nn 


(4.65) 


Redefining  the  half-endcap  as  cje  in  equation  4.66,  the  expression  for  the  end- 
cap  radiance  is  given  by  equation  4.67.  L  (0, 0)  is  the  radiance  coming  from  di¬ 
rectly  overhead;  it  is  a  constant.  The  two  tt  terms  are  kept  to  clarify  that  the  first 
converts  directional  irradiance  to  directional  radiance,  and  the  second  is  part  of  the 
solid  angle  calculation. 
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Cloud  error  simulation 

The  discussion  so  far  provided  the  guts  of  the  cloud  radiance  model.  It  has  limita¬ 
tions,  but  it  has  enough  fidelity  to  fulfill  ifs  sfafed  purpose  of  quanlifying  fhe  vari- 
abilify  in  relleclance  inversion  due  fo  cerfain  types  of  cloud  cover,  namely  fhe  fypes 
fhaf  are  modeled  here.  In  ofher  words,  fhe  model  sefs  ifs  sighfs  low  buf  soundly 
delivers.  The  error  propagafion  mefhodology  can  exercise  fhe  cloud  model  fo  pro¬ 
vide  addifional  relleclance  bias  error  due  fo  clouds.  To  enable  Ihis,  a  cloud  error 
simulation  is  prepared  as  follows: 
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1 .  Minimum  and  maximum  cloud  cover  values  are  chosen  in  terms  of  number 
of  quads  set  to  cloud 

2.  A  statistically  large  number  of  random  cloud  configurations  are  generated 

3.  A  total  sky  radiance  spectrum  is  numerically  integrated  for  each  configura¬ 
tion 

4.  The  root  sum  square  of  the  difference  between  each  cloudy  sky  radiance 
spectrum  and  the  clear  sky  spectrum  is  taken 

5.  The  percent  sky  coverage  is  calculated  for  each  quad  configuration 

6.  The  results  are  parameterized  and  saved  according  to  fraction  of  the  sky 
covered  by  clouds 

As  mentioned  earlier,  a  quad  is  “set”  to  be  a  cloud  or  to  clear  sky  by  changing 
its  integer  index  in  the  cloud  map.  In  this  simulation,  0  in  the  cloud  map  represents 
clear  sky,  a  1  is  a  dark  cloud,  a  2  is  a  bright  cloud,  and  a  -1  is  zero  radiance  (used 
for  obscuration  calculations  elsewhere  in  the  model).  Each  random  configuration 
has  a  certain  number  of  quads  active.  For  example,  the  first  group  of  random 
configurations  all  have  exactly  4  quads  set  to  clouds,  the  next  all  have  5,  and  so  on 
until  the  maximum  number  is  reached.  In  summary,  the  following  statements  are 
true: 


•  The  number  of  activated  quads  in  each  random  configuration  set  is  gradu¬ 
ally  incremented  until  the  maximum  value  is  reached  (roughly  half  the  total 
number  of  quads) 

•  The  cloud  location  and  subtype  (bright  or  dark)  is  random  according  to  a 
uniform  distribution 

•  The  basic  cloud  type  (cumulus,  stratus,  etc.)  is  chosen  at  the  outset  and  not 
changed 

•  The  multiple  scattering  algorithm  (ISAAC  2-stream  or  DISORT  8-stream)  is 
chosen  at  the  outset  and  not  changed 

•  The  quad  containing  the  sun  is  never  permitted  to  be  obscured 

A  statistical  approach  was  chosen  as  a  way  to  sample  the  space  of  possible  re¬ 
sults.  The  prime  alternative  would  be  to  simulate  one  of  every  possible  quad  con¬ 
figuration.  Even  when  optimizing  for  symmetry,  the  combinatorial  requirements 
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are  staggering,  taking  more  than  4  years  for  the  72  quad  ease  at  100  radianee  eal- 
eulations  per  seeond.  The  number  is  inealeulable  for  the  1224  quad  ease. 

The  sky  fraetion  is  ealeulated  based  on  the  two-dimensional  size  of  eaeh  quad 
relative  to  the  whole  hemisphere.  Quads  at  lower  zenith  angles  are  smaller  than 
those  at  higher  zenith  angles,  therefore  random  eonfigurations  of  any  n  quads 
will  eontain  quads  of  different  sizes,  and  eaeh  n-quad  result  will  be  paired  with 
a  slightly  different  sky  eover  fraetion. 

Beeause  the  eloud  type  and  multiple  seattering  algorithm  are  intrinsie  to  the 
simulation,  eaeh  different  setting  is  saved  as  a  separate  simulation  dataset,  available 
for  use  depending  on  the  error  propagation  seenario.  However,  preliminary  results 
suggest  that  the  multiple  seattering  algorithm  and  eloud  type  have  basieally  zero 
bearing  on  the  overall  error.  Faetors  not  eonsidered  inelude  the  eloud  height  and 
transpareney.  Cloud  height  (teehnieally  eloud  range)  ehanges  the  amount  of  path 
radianee  observed,  and  transpareney  allows  a  more  realistie  mixture  of  sky  radianee 
and  eloud  radianee  within  a  quad. 

Finally,  eloud  shadows  were  not  allowed.  Although  they  are  common  in  scenes, 
allowing  clouds  to  obscure  the  sun  makes  radiometric  calculations  next  to  impossi¬ 
ble.  In  short,  there  is  no  single  thing  that  can  be  called  a  “cloud  shadow.”  Empirical 
evidence  shows  that  the  radiance  within  a  shadow  is  constantly  changing,  even  ex¬ 
ceeding  clear-sky  radiance  under  certain  conditions.  Other  shadows  are  modeled 
as  equation  3.3  minus  the  exoatmospheric  solar  irradiance  term;  this  is  not  the  case 
with  cloud  shadows. 

Cloud  error  incorporation 

To  use  the  cloud  error  databases  in  the  error  propagation  code,  the  scenario  must 
specify  a  cloud  cover  amount  and  sampling  slice  width.  The  sampling  slice  is 
conceptually  identical  to  spectral  sampling  that  a  sensor  does,  only  with  cloud 
cover.  A  nominal  value  of  2%  is  sufficient  to  specify  sufficient  data  for  a  robust 
error  calculation.  The  bias  error  for  reflectance  as  a  result  of  cloud-induced  changes 
in  downwelled  radiance  is  found  from  equation  4.43. 

All  spectra  matching  the  requested  sky  cover  fraction  are  retrieved  and  used  to 
calculate  bias  error.  Then,  the  entire  ensemble  of  bias  errors  is  carried  through  to 
the  end.  No  summary  statistics  are  calculated  on  the  bias  spectra  because  the  goal  is 
to  observe  the  effect  of  any  one  of  these  possible  configurations  on  the  final  resulf. 
Averaging  fhe  cloud  specfra  fogefher  eliminafes  much  of  fhe  variability  fhaf  makes 
clouds  so  invidious.  Using  fhe  average  and  reporfing  fhe  variability  as  sfandard 
deviation  would  merely  require  anofher  apparafus  fo  communicate  the  variability, 
whereas  keeping  the  whole  dataset  already  accomplishes  that  purpose. 
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4.13.3  Background  objects 

Interestingly  enough,  a  separate  baekground  radianee  term  is  absent  from  equation 
3.3,  the  main  radiative  transport  equation.  Baekground  objeets  are  often  ignored, 
and  rightly  so.  They  are  restrieted  to  the  horizon,  meaning  their  angle  of  ineidenee 
is  usually  low.  Instead,  it  is  ineorporated  into  the  downwelled  radianee  term  of 
equation  3.5.  Their  radianee  eontribution,  just  like  the  sky  radianee  they  replaee, 
is  always  a  small  eontribution  to  the  overall  downwelled  radianee  term.  For  open 
spaee,  a  terrain  masking  angle  (as  illustrated  in  figure  3.1)  of  15°  or  less  requires 
a  30  ft  (9.1  m)  tall  objeet  to  be  only  112  ft  (34  m)  away.  At  15°  elevation  or  85° 
zenith,  the  irradianee  is  less  than  25%  of  what  it  would  be  at  zenith.  However, 
these  are  just  example  ealeulations,  and  the  situations  aetually  eneountered  may  or 
may  not  be  greatly  affeeted  by  baekground  objeets.  The  assumption  that  terrain 
masking  angle  is  low  is  not  universally  valid.  Often,  images  eontain  struetures, 
and  those  struetures  have  pixels  next  to  them,  and  likewise  for  trees.  Researeh  has 
been  eondueted  eoneerning  the  effeets  of  “treeshine”  on  target  deteetion  algorithms 
(Raqueno  et  ah,  2005),  and  whether  it  is  beeause  they  ean  ehange  the  speetral 
eharaeter  and  magnitude  of  sky  radianee  or  shade  the  ground  from  direet  solar 
irradianee,  baekground  objeets  deserve  attention. 

The  mathematieal  eontribution  from  baekground  objeets  was  detailed  in  equa¬ 
tion  3.5.  They  are  nominally  part  of  the  diffuse  downwelled  radianee  term  in  that 
they  bloek  a  portion  of  the  sky  that  would  normally  be  providing  seattered  sky  ra¬ 
dianee  and  replaee  it  with  their  own  radianee.  In  a  proeess  that  is  very  similar  to 
the  eloud  error  propagation  model  deseribed  earlier,  the  baekground  objeet  model 
performs  a  rudimentary  series  of  simulations  to  determine  that  baekground  objeet 
radianee  and  eompares  it  to  the  elear  sky  downwelled  term. 


The  background  object 

Just  like  with  eloud  modeling,  there  is  an  infinite  variety  of  ways  a  baekground 
objeet  ean  look  to  a  ground  target.  The  primary  equation  governing  baekground 
radianee  is  equation  4.73.  It  is  a  miniature  version  of  the  main  radianee  expression 
in  equation  3.3.  The  main  sourees  of  irradianee  ineident  on  a  baekground  objeet 
are  identieal  to  those  onto  any  flat  target:  direet  solar  irradianee,  integrated  diffuse 
sky  radianee,  and  radianee  refleeted  from  the  ground.  This  formulation  does  not 
explieitly  inelude  radianee  that  might  be  eoming  from  other  baekground  objeets, 
but  implieitly  aeeounts  for  it  in  the  way  ground  refleeted  radianee  is  determined. 
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Figure  4.22:  Radiance  sources  for  a  background  object 


Figure  4.22  illustrates  the  terms  in  equation  4.73.  The  downwelled  radiance 
term  is  present,  but  it  is  calculated  somewhat  differently  than  for  a  flat  target.  Only 
radiance  from  the  half-hemisphere  facing  the  object  can  reflect  off  the  vertical  face. 
Also,  the  zenith  angle  is  now  rotated  by  90°  such  that  rays  from  directly  overhead 
barely  graze  the  object.  Direct  solar  radiance  is  also  present,  but  only  if  the  local 
zenith  angle  is  less  than  90°. 

The  other  half  hemisphere  now  views  distant  background  objects  and  radiance 
reflecting  off  the  ground.  This  ground  source  is  significant  due  to  the  presence 
of  direct  solar  radiance  reflecting  off  of  it.  What  is  normally  downwelled  sky  ra¬ 
diance  for  a  flat  target  is  now  a  half-hemisphere  of  earth  albedo.  Equation  4.69 
shows  the  half-hemisphere  integration  for  an  assumed  constant  ground  albedo.  In 
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reality  it  is  different  for  eaeh  point  on  the  ground,  however  for  modeling  expedi- 
eney  a  representative  speetral  profile  was  ehosen.  This  representative  eurve  was 
then  propagated  through  MODTRAN  to  produee  total  radianee  leaving  adjaeent 
ground  at  a  45°  slant  angle,  whieh  was  then  used  as  Lg^d- 


Ld,gnd  — 


L 


gnd 


TT 


_  ^gnd  ^ 

TT 


d(j)  /  cos  ah  sin  abdat 

i>=0  J  ai,=0 

sin^  I  -sin2o\  _  Lg^d 


(4.69) 


A  single  albedo  eurve  was  used  to  model  adjaeent  ground  refleetanee,  and  an¬ 
other  speetrum  was  used  for  the  baekground  objeet  refleetanee.  To  attempt  to  ae- 
eount  for  statistieal  variability,  eaeh  eurve  was  eonstrueted  with  a  linear  mixture 
of  representative  material  type  refleetanee  eurves.  The  eurves  were  taken  from  the 
DIRSIG  speetral  library  (lentilueei  and  Brown,  2003),  linearly  mixed  aeeording 
to  set,  arbitrarily-ehosen  fraetions  thought  to  be  representative  of  typieal  seenes, 
and  downsampled  to  MODTRAN’s  preferred  number  of  speetral  points.  For  ad¬ 
jaeent  ground,  the  target  was  eomposed  of  60%  asphalt,  10%  eonerete,  and  40% 
dirt  and  grass,  assuming  that  manmade  struetures  would  be  surrounded  by  parking 
lots,  streets,  and  sidewalks,  while  baekground  trees  would  be  surrounded  by  dirt 
and  grass.  The  baekground  objeet  albedo  was  eonstrueted  with  55%  trees,  20% 
painted  steel,  20%  eonerete,  and  5%  asphalt,  again  assuming  baekground  objeets 
were  roughly  evenly  divided  between  natural  and  manmade  struetures. 

Empirieal  speetrometer  measurements  of  vertieal  baekground  targets  were  made 
and  eompared  with  the  resulting  objeet-leaving  radianee  eurves.  This  validation  re¬ 
sult  is  shown  in  figure  4.23.  Two  side-looking  sun-illuminated  tree  speetra  and  two 
mixed  tree/asphalt  speetra  were  taken.  At  the  same  time  a  sky  radianee  speetrum 
was  taken  from  a  portion  of  the  sky  90°  of  azimuth  away  from  the  solar  azimuth 
angle.  A  simulated  downwelled  radianee  speetrum  and  four  sun-illuminated  simu¬ 
lated  baekground  objeet  radianee  speetra  are  overplotted  on  the  figure.  The  simu¬ 
lated  and  empirieal  eurves  roughly  mateh  in  magnitude  and  speetral  features,  with 
a  notable  deviation  between  400-500  nm,  whieh  is  believed  to  be  due  to  path  length 
differenees  between  the  simulated  and  measured  speetra.  The  path  length  differ- 
enees  would  result  in  differing  amounts  of  path  flare  eaused  by  moleeular  seatter- 
ing,  and  the  speetra  with  greater  path  flare  would  have  higher  signal  in  the  blue 
speetral  regions,  where  path  seattering  is  most  prominent.  This  preliminary  result 
provides  a  degree  of  eonfidenee  that  baekground  objeets  are  adequately  modeled 
and  ean  be  used  in  the  error  propagation  simulation. 
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Figure  4.23:  Background  radiance,  measured  vs  predicted 


Background  object  error  incorporation 

Building  a  library  of  background  object  radiances  follows  a  procedure  very  sim¬ 
ilar  to  how  cloudy-sky  downwelled  radiance  spectra  were  made.  The  object  was 
assumed  to  receive  a  half-hemisphere’s  worth  of  directionally-dependent  sky  ra¬ 
diance  and  a  constant,  isotropic  half-hemisphere’s  worth  of  ground  radiance.  The 
setup  is  notionally  illustrated  in  figure  4.24,  except  the  angular  separation  between 
the  solar  azimuth  and  the  local  normal  azimuth  is  not  shown.  Since  a  quad-indexed 
database  will  be  populated  with  the  results  of  calculating  the  adapted  form  of 
equation  4.65,  and  it  is  known  that  the  half-hemisphere  seen  by  the  vertical  ob¬ 
ject  is  azimuth-dependent,  this  must  be  accounted  for  when  building  up  the  quad 
database. 

The  azimuthal  rotation  is  implemented  by  introducing  a  local  axis  convention 
and  angular  rotation.  There  is  a  distinct  set  of  angular  rotations  for  each  azimuthal 
position.  This  would  not  normally  be  so  critical,  however  the  dominance  of  the 
solar  irradiance  on  the  eventual  result  makes  it  more  important  to  model  direct  solar 
illumination,  grazing  solar  illumination,  and  shaded  cases  of  background  radiance. 
A  full  set  of  background  objects  placed  at  each  of  the  different  azimuth  angles  is 
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Figure  4.24:  Quad  integration  approach  for  background  objects 


shown  in  figure  4.25. 

No  matter  what  azimuth  rotation  scheme  is  used,  there  must  be  at  least  one 
coordinate  transformation  to  account  for  the  change  from  a  flat  target  to  a  vertical 
target.  The  local  reference  system  is  comprised  of  an  x-axis  unit  vector  pointing 
in  the  0°  azimuth  direction,  a  z-axis  unit  vector  pointing  up  in  the  direction  of  the 
local  normal,  and  a  y-axis  unit  vector  oriented  to  make  a  right-handed  system.  The 
axis  rotation  is  accomplished  by  rotating  -i-90°  about  the  local  x-axis.  The  generic 
transformation  matrix  about  the  x-axis  is  given  as  follows,  where  6x  is  a  generic 
angle  of  rotation  about  that  axis: 


Tx 


1  0  0 
0  cos  9x  sin  9x 

0  —  sin  9x  cos  9x 


To  orient  the  object’s  face  with  a  particular  azimuth,  the  face  is  rotated  about  the 
z-axis  before  the  x-axis  rotation.  This  would  be  equivalent  to  performing  a  y-axis 
rotation  after  the  x-axis  rotation.  The  z-axis  coordinate  transform  is  defined  as: 

cos  9z  sin  9z  0 
—  sin  9z  cos  9z  0 
0  0  1 
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Figure  4.25:  Azimuthal  variation  in  simulated  background  objects 


In  this  case,  the  generic  rotation  angle  0^  is  replaced  hy  ^  —  7r/2,  where  cf)  is  the 
azimuth  to  the  object.  Thus,  an  object  at  0°  azimuth  relative  to  the  final  target 
faces  back  towards  the  center  at  an  azimuth  of  180°.  The  angle  used  for  cj)  in  the 
transform  is  0°. 

Implementation  of  the  transforms  is  accomplished  in  equation  4.70.  The  vec¬ 
tors  X  and  X'  are  relative  to  a  three-axis  orthogonal  reference.  They  relate  to  the 
polar  coordinates  being  used  through  equation  4.7 1. 

X'  =  TxTzX  (4.70) 


X 

p  cos  (  f  —  O')  cos  (j) 

y 

= 

pcos  (1  —  a)  sin  cj) 

z 

psin  (1  —  (t) 

(4.71) 


Following  transformation  to  the  rotated  frame,  the  rotated  angles  are  obtained 
through  4.72.  In  practice  only  the  new  zenith  angle  is  required,  but  it  is  a  function 
of  both  the  original  azimuth  and  zenith  that  were  relative  to  the  local  horizontal. 
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Following  this  method,  a  different  set  of  quads  ean  be  set  to  be  “visible”  by 
the  vertieal  baekground  objeet  for  eaeh  azimuth  position.  The  quads  visible  by 
the  tilted  objeet  were  ehosen  in  the  loeal  horizontal  referenee  frame  to  be  the  half¬ 
hemisphere  of  quads  direetly  opposite  the  objeet.  Those  radianees  are  indexed  to 
the  unrotated  frame  and  do  not  require  transformation  so  long  as  the  eorreet  quads 
are  aetivated  and  the  other  quads  are  set  to  zero  radianee  eontribution.  The  rotated 
angles  are  used  in  the  eosine  and  sine  terms  of  the  ealeulation. 


■^sky,bkg 


=  EE  L  {a,  (f))  cos  a'  sin  ad(f>da 


(4.73) 


Onee  the  database  of  baekground  objeet-filled  quads  has  been  built,  using  the 
database  to  generate  sets  of  randomly  eonfigured  quads  is  identieal  to  the  pro- 
eess  used  to  index  sky  fraetion  obseured  by  elouds  to  eloudy-sky  radianee.  A  key 
differenee  is  that  in  this  speeifie  implementation  of  baekground  objeet  radianee 
simulation,  baekground  objeets  were  assumed  to  only  oeeupy  the  lowest  elevation 
(highest  zenith)  ring  of  quads.  Sinee  all  quads  eorresponding  to  a  partieular  zenith 
are  the  same  size,  the  relation  of  sky  fraetion  obseured  by  baekground  objeets  to 
number  of  quads  takes  on  diserete  values;  a  eertain  number  of  quads  set  to  baek¬ 
ground  always  produees  the  same  sky  fraetion.  This  eould  ehange  in  subsequent 
simulations  if  more  zenith  rings  were  permitted  to  take  on  baekground  objeet  radi¬ 
anees.  Other  than  this,  the  proeess  of  generating  random  quad  eonfigurations  and 
eolleeting  their  effeets  on  downwelled  radianee  is  identieal  to  the  proeess  used  to 
model  elouds.  The  propagation  of  bias  error  into  final  refleetanee  is  aeeomplished 
using  equation  4.43. 


4.13.4  Pointing 

Off-nadir  sensor  pointing  is  a  self-limiting  exeeption  among  environmental  effeets. 
First,  while  it  is  possible  to  drive  the  radianee  refleeted  off  the  ground  to  zero 
by  suffieiently  inereasing  the  view  angle,  this  is  impraetieal  beeause  the  image 
pixel  would  no  longer  be  in  the  image.  Seeond,  it  is  trivial  to  know  the  exaet 
pointing  angle  (within  a  degree  of  random  error)  for  every  pixel  in  the  image, 
so  the  intraetability  introdueed  by  the  seeond  implieation  above  does  not  apply. 
Third,  model-based  inversion  algorithms  ean  aeeount  for  off-nadir  pointing  effeets 
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without  external  adjustment  because  an  off-nadir  effect  is  functionally  identical  to 
a  spatial  variation  in  the  atmospheric  parameters. 

The  nadir  vector  originates  at  the  sensing  platform  and  is  collinear  with  but 
has  the  opposite  sign  of  the  normal  vector  of  the  terrestrial  point  directly  below 
the  platform.  The  pointing  angle,  which  will  be  called  tp,  is  the  angle  between  this 
vector  and  the  vector  along  which  photons  travel  into  the  sensor.  Depending  on 
the  sensor’s  basic  architecture,  the  details  of  how  this  is  precisely  defined  varies. 
However,  the  vector’s  definition  is  external  to  the  sensing  platform.  The  setup  is 
shown  in  figure  4.26. 


Figure  4.26:  Nadir  and  off-nadir  pointing  terms 


To  account  for  the  effects  of  pointing  off-nadir,  changes  in  upwelled  radiance 
(Lu)  and  ground-sensor  transmissivity  (T2)  due  to  path  length  differences  must 
be  modeled.  The  same  MODTRAN  scenario  is  run  multiple  times  using  different 
zenith  angles.  In  the  terminology  here,  nadir-pointing  corresponds  to  a  zenith  angle 
of  180°.  It  is  also  possible  to  vary  the  azimuth  angle.  Figure  4.27  shows  the  result 
of  sampling  this  parameter  space  for  upwelled  radiance  at  550  nm.  The  figure  takes 
on  the  shape  of  a  bowl  where  each  azimuthal  position  around  the  bowl  corresponds 
to  an  azimuth  and  distance  from  the  center  represents  a  different  pointing  angle, 
which  ranged  from  -45°  to  -i-45°  off  nadir.  The  bowl  appears  to  be  symmetrical. 
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but  this  is  just  a  result  of  how  the  space  was  sampled.  The  actual  center  of  the  bowl 
for  upwelled  radiance  is  off-center  based  on  the  position  of  the  sun.  The  “off-nadir 
bowl”  for  T2  actually  is  symmetrical  and  points  downward  rather  than  upward.  This 
figure  has  a  distinct  realization  for  every  wavelength. 


Upwelled  radiance  by  azimuth  and  angle 


Figure  4.27:  Upwelled  radiance  by  azimuth  and  nadir  angle 


In  practice  it  is  unnecessary  to  sample  different  azimuths  because  a  sensing 
platform’s  motion  will  define  an  along-frack  and  cross-frack  direction.  The  along- 
frack  direcfion  will  define  fhe  azimufh  used  for  fhe  off-nadir  angle  sampling.  The 
cross-frack  off-nadir  pointing  resulfs  are  assumed  fo  be  fhe  same  for  every  imaging 
line,  meaning  fhe  sensing  plafform  alfifude  and  sun  angle  do  nol  change  across 
fhe  image.  This  smearing  of  one  azimufh  in  fhe  along-frack  direcfion  is  shown  in 
figures  4.28(a)  (upwelled  radiance)  and  4.28(b)  (ttansmissivify). 

Resulfs  were  generafed  for  a  sensor  af  792  m  (approximafely  600  m  above 
ground  level),  4  km,  1 1  km,  and  100  km  and  will  be  presented  in  section  5.5.  The 
alfifude  used  is  user-selecfable.  Once  fhe  desired  dafasef  is  unpacked,  a  fourfh- 
order  polynomial  curve  is  til  fo  each  wavelengfh  and  sen!  fo  fhe  error  propagafion 
model,  which  uses  fhe  coefficienls  fo  reproduce  fhe  off-nadir  and  T2  resulfs  for 
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Figure  4.28:  Variation  in  and  T2  by  pointing  angle,  relative  to  nadir 
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any  angle.  The  sensing  seenario  speeifies  the  off-nadir  pointing  angle,  for  whieh 
the  bias  error  is  ealeulated  using  equation  4.38.  Random  error  due  to  pointing 
angle  knowledge  uneertainty  is  analytieally  ealeulated  from  the  first  derivative  of 
the  eurve  fit,  with  the  result  added  in  quadrature  with  other  types  of  errors  in  these 
two  terms. 

A  final  nofe  on  pointing  error  is  fhaf  fhe  mulfiple  seaffering  algorifhm  was 
found  fo  be  signifieanl.  The  fwo  options  builf  info  fhe  model  are  Isaae’s  fasl-bul- 
inaeeurafe  fwo-sfream  algorifhm  and  fhe  more  rigorous  diserefe  ordinafe  (DISORT) 
algorifhm  using  8  sfreams.  The  fwo-sfream  algorifhm  was  found  fo  be  adequafe  in 
ealeulafing  a  numerieal  derivative  using  fhe  relafive  differenees  in  elose  proximify 
fo  a  eenfral  value  (seefion  4.7).  However,  diserepaneies  of  up  fo  1%  of  fhe  upwelled 
radianee  were  observed  af  lower  wavelengfhs,  so,  as  wifh  fhe  numerieal  derivafives, 
fhe  DISORT  mulfiple  seaffering  algorifhm  was  used  ouf  of  prudenee. 


4.14  Scenario  setup 

Given  a  full  sef  of  error  models  eapable  of  eovering  eaeh  term  in  fhe  governing 
equafion,  a  baseline  sef  of  parameters  was  esfablished  for  all  error  modeling  efforls. 
Any  resulfs  are  anehored  fo  speeifie  seenario  paramefers,  parfieularly  fhe  geomefrie 
eondifions,  so  fhis  seenario  baseline  is  neeessary  fo  a  eonfrolled  and  eomprehen- 
sible  approaeh  fo  generating  resulfs.  The  ttadeoff  of  resfriefing  modeling  fo  one 
speeifie  seenario  is  a  loss  of  generalify,  buf  fhis  eannof  be  avoided.  Seeond,  fhird, 
or  more  seenarios  ean  be  added  af  any  time  and  are  lefl  fo  fufure  work.  If  is  suf- 
fieienf  for  fhis  work  fo  demonsfrafe  and  validate  fhe  modeling  mefhod  and  use  fhe 
resulfs  fo  draw  eonelusions  abouf  fhis  sef  of  seenario  paramefers  and  perhaps  ofhers 
similar  fo  if.  The  speeifie  seenario  paramefers  are  presented  in  fables  4.1,  4.2,  and 
4.3.  If  is  key  fo  fix  fhe  geomefry  and  afmospherie  baseline  beeause  in  a  non-linear 
system,  fhe  sensifivify  eurves  ehange  in  response  fo  ehanges  in  fhese  paramefers. 
In  a  developmenfal  eonfexf,  fixing  a  single  sef  of  parameters  faeililaled  explorafion 
of  fhe  researeh  spaee,  requiring  fens  of  fhousands  of  MODTRAN  runs.  Onee  fhe 
mefhodology  is  esfablished,  less  fhan  10  MODTRAN  runs  are  required  fo  esfablish 
fhe  radiomefrie  modeling  baseline,  whieh  musf  be  reeonsfruefed  for  fhe  parfieular 
geomefry  of  eaeh  image. 

Table  4.2  ineludes  several  parameter  opfions  fhaf  are  seleefable  af  run-time. 
These  exisf  only  for  model  demonsfrafion  purposes  and  would  be  unneeessary  in  an 
operafional  version  of  fhe  model.  Alfifude  seleefion  allows  fhe  model  presenfafion 
fo  show  any  differenees  befween  airborne  and  spaeeborne  sensors  wifh  regards  fo 
uneerfainfy  eaused  by  sysfemafie  and  random  nadir  angle  errors.  The  sample  sensor 
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Table  4.1:  Baseline  Seenario  Geometry 


Parameter 

Value 

Date 

May  12,  2006 

Time 

15:35:35  GMT 

Latitude 

42.93°  N 

Longitude 

78.73°  W 

Ground  altitude 

0.218  km 

Table  4.2:  Baseline  Sensor  Parameters 


Parameter 

Value 

Options 

Sensor  altitude 

100  km 

792  m,  4  km,  11  km 
for  pointing  errors  only 

Sensor  pointing 

nadir  (0°) 

0^5° 

Band  model 

400-2500  nm  (2  nm  eenters) 

- 

Band  repsonse 

triangular,  4  nm  FWHM 

- 

Noise  model 

none 

AVIRIS  (1997-9  eals), 
Hyperion,  HYDICE 

Table  4.3:  Baseline  MODTRAN  Atmospherie  Parameters 


Parameter 

Value 

Model  Capability 

Atmospherie  profile 

1976  Standard  atmosphere 

Complete  eontrol 
at  36  altitude  levels 

Water  vapor  profile 

midlatitude  summer 

any 

Multiple  seattering 

ISAAC  2-stream  (at  ground) 

DISORT  8-stream 

Target  altitude 

0.218  km 

0-5  km 

Visibility 

15  km 

2-100  km 

Water  vapor 

2.0  g/em^ 

0-2.63  gm/em^ 
(varies  by  model) 

CO2  eoneentration 

373  ppm 

any 
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noise  models  exist  to  exereise  the  portion  of  the  model  that  aeeounts  for  ealibration 
uneertainty.  Finally,  table  4.4  lists  several  other  model  options  that  are  not  ineluded 
in  the  baseline  eonfiguration  but  ean  be  added  to  prediet  the  relative  magnitudes 
of  various  effects  in  relation  to  the  standard  error  sources.  These  include  ground 
tilt,  cloud  cover,  and  background  object  cover.  The  modeling  methodology  for 
these  was  described  in  earlier  sections,  and  the  input  ranges  are  listed  in  the  table. 
Finally,  it  is  critical  to  note  target  reflectance  can  be  specified  either  as  a  spectrally 
constant  scalar  or  as  a  spectrum. 


Table  4.4:  Other  Selectable  Parameters 


Parameter 

Specified  As 

Range 

Ground  tilt 

Angle  in  degrees 

0-45° 

Cloud  cover 

Sky  fraction,  0-1.0 

0-0.45 

Cloud  cover  knowledge 

Sky  fraction  uncertainty 

0-0.2,  0-0.05  typical 

Background  objects 

Sky  fraction,  0-1.0 

0-0.25 

Background  object  knowledge 

Sky  fraction  uncertainty 

0-0.1,  0-0.05  typical 

Target  reflectance 

Scalar  or  spectral  vector 

O.O-l.O 

The  default  scenario  conditions  were  chosen  to  blend  conditions  at  Buffalo  In¬ 
ternational  Airport  and  Rochester  Institute  of  Technology.  Buffalo’s  location  and 
altitude  were  used  so  the  results  could  be  correlated  with  historical  meteorological 
data  collected  at  the  National  Weather  Service  station,  in  particular  the  tempera¬ 
ture,  pressure,  dew  point,  and  radiosonde  data.  Sensing  geometry  was  taken  from 
an  airborne  imagery  collect  over  RIT  so  that  radiance  results  could  be  compared 
to  the  collected  data.  These  parameters  include  primarily  date  and  time,  but  one  of 
the  sensor  altitude  options  built  into  the  model  matches  the  aircraft  altitude  during 
the  collect.  The  collected  imagery  and  metadata  together  did  not  produce  a  useful 
data  set  that  could  be  used  to  validate  this  work,  so  the  scenario  selection  rationale 
is  now  immaterial.  In  general,  the  important  thing  is  that  the  scenario  parame¬ 
ters  used  match  the  actual  or  expected  collection  geometry  treated  by  the  model’s 
application. 

4.15  Validation 

Validation  is  a  key  task  for  any  scientific  work.  It  was  listed  as  an  objective  of 
this  investigation,  and  both  simulation  results  and  real-world  collection  data  were 
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planned  to  be  part  of  the  validation  proeess.  Beeause  elaims  are  made  regarding 
uneertainty  in  absolute  terms  rather  than  relative  terms,  it  is  imperative  that  some 
level  of  eonfidenee  in  these  results  is  generated.  MODTRAN  simulation  is  used  to 
generate  statistieal  distributions  of  retrieved  refleetanee  resulting  from  uneertainty 
in  atmospherie  eonstituents.  Despite  the  initial  plan  to  also  use  aetual  eolleetion 
data  to  validate  these  and  other  results  (sueh  as  the  environmental  effeets),  it  was 
diseovered  that  parts  of  this  approaeh  bordered  on  the  impossible.  It  is  feasible 
to  perform  atmospherie  inversion  with  aetual  eonstituent  determination  and  per¬ 
turb  these  eonstituents  to  inerease  the  error,  but  validating  effeets  sueh  as  eloud 
and  baekground  radianee  using  statistieal  language  and  real-world  data  introduees 
a  host  of  approximations  and  impreeisions  that  tend  to  negate  the  value  of  the  val¬ 
idation  effort.  The  assumption  here  is  that  if  simulation  ean  be  used  to  validate  the 
analytieal  teehniques  of  error  propagation,  then  higher  eonfidenee  ean  be  plaeed  in 
other  parts  of  the  model  employing  the  same  error  propagation  teehniques. 

It  is  elaimed  that  the  error  propagation  model  delivers  the  ability  to  tie  eon¬ 
stituent  errors  with  environmental  errors  and  propagate  both  into  refleetanee  spaee. 
Despite  the  many  plug-in  sub-models  built  to  hang  off  it,  the  eore  engine  is  the 
most  eritieal  pieee  to  validate.  Thus,  a  final  validation  approaeh  was  seleeted  that 
balanees  effeetiveness  with  simplieity,  foeusing  on  just  the  eore  propagation  eapa- 
bility.  The  ability  to  prediet  a  statistieal  distribution  without  instantiating  random 
variables  is  the  model’s  primary  value.  The  validation  approaeh  will  eompare  the 
deterministie  results  with  aetual  random  results  for  identieal  atmospherie  and  geo- 
metrie  seenarios. 

A  Monte  Carlo-style  simulation  was  eonstrueted  in  whieh  a  retrieved  refleetanee 
error  is  simulated  by  inducing  error  in  the  atmospheric  parameters.  The  simu¬ 
lated  situation  is  shown  by  equations  4.74  and  4.75.  Equation  4.74  represents  the 
truth  state,  and  equation  4.75  represents  an  erroneous  retrieval.  The  total  calibrated 
radiance  is  the  same,  but  due  to  supposed  errors  in  atmospheric  constituent  de¬ 
termination,  the  estimated  reflectance  (and  by  extension  the  estimated  component 
radiance)  is  off  by  some  amount.  The  terms  r  and  f  represent  the  true  reflectance 
and  the  erroneous  retrieved  reflectance.  The  atmosphere  operator  is  fixed  but  im¬ 
perfectly  estimated  quantity  during  this  process. 


L  —  Lgnd'l^  +  L[J 

(4.74) 

L  =  Lgndf  +  Lij 

(4.75) 

The  definition  of  Lgnd  is  given  by  equation  4.76: 
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Lgnd  =  ^s’Tl  +  Ldj  T2  (4.76) 

Equation  4.77  shows  the  method  by  whieh  the  validation  seenario  is  simu¬ 
lated.  Beeause  refleetanee  errors  indueed  by  eonstituent  uneertainty  ean  only  be 
indireetly  treated  by  the  radiative  transfer  modeling  proeess,  error  in  atmospherie 
eonstituent  knowledge  must  be  simulated  as  a  perturbation  in  the  MODTRAN  in¬ 
put  parameters.  The  effeet  must  then  be  deteeted  in  the  radianee  outputs.  Whereas 
refleetanee  retrieval  errors  would  not  affeet  sensor-reaehing  radianee,  the  indireet 
simulation  method  keeps  refleetanee  eonstant,  instead  eolleeting  these  errors  in  the 
sensor-reaehing  radianee  term.  To  return  to  the  situation  in  equation  4.75,  the  orig¬ 
inal  radianee  is  substituted  for  the  perturbed  radianee  and  inverted.  Terms  Lgnd 
and  Lij  are  obtained  from  input-perturbed  MODTRAN  runs.  Then,  it  is  assumed 
the  defeet  exists  in  r,  not  L,  so  refleetanee  errors  are  isolated  aeeording  to  equation 
4.78,  where  eaeh  term  eorresponds  to  the  terms  in  equation  pair  4.77. 


L  —  Lgndi^  +  Ljj 


(4.77) 


.  (L-Lu) 

r  =  — ^ - 

Lgnd 


(4.78) 


For  eaeh  seenario,  a  mean  value,  distribution  width,  and  distribution  shape 
were  assumed  for  the  input  parameter  under  study.  An  arbitrarily  large  (nominally 
600)  random  sample  of  parameter  values  was  eonstrueted  by  aeeessing  a  random 
distribution  possessing  the  eharaeteristies  in  table  4.5.  Note  that  for  the  translation 
of  optieal  depth  error  to  visibility,  ±0.02  translated  to  ±0.8  and  —0.7  km.  These 
were  averaged  together  for  brevity’s  sake.  MODTRAN  was  run  with  eaeh  input 
parameter  in  the  random  sample,  and  the  refleetanees  were  ealeulated  aeeording 
to  equation  4.78.  The  first  run  in  eaeh  seenario  was  unperturbed  and  provided  the 
“truth”  radianees  required  by  equation  4.78.  Results  for  100%  and  20%  refleetors 
will  be  presented  in  ehapter  5. 
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Table  4.5:  Validation  scenario  summary 


Validation  parameter 

Distribution 

Mean 

Std  dev 

VI 

water  vapor  -  dry 

normal 

0.75  cm 

0.2  cm 

V2 

water  vapor  -  dry 

normal 

0.75  cm 

0.1  cm 

V3 

water  vapor  -  wet 

normal 

2.0  cm 

0.2  cm 

V4 

water  vapor  -  wet 

normal 

2.0  cm 

0.1  cm 

V5 

density  altitude 

normal 

0.218  km 

0.02  km 

V6 

density  altitude 

normal 

0.218  km 

0.01  km 

V7 

aerosol  optical  depth 

log-normal 

0.447  (15  km) 

0.04  (1.55  km) 

V8 

aerosol  optical  depth 

log-normal 

0.447  (15  km) 

0.02  (0.75  km) 

V9 

multiple  parameters 
water  vapor 

normal 

2.0  cm 

0.2  cm 

density  altitude 

normal 

0.218  km 

0.045  km 

aerosol  optical  depth 

log-normal 

0.456 

0.02 

Chapter  5 

Results  and  Discussion 


An  approach  has  been  presented  that  allows  the  estimation  of  atmospheric  inver¬ 
sion  error  using  basic  error  propagation  theory  and  radiative  transfer  modeling 
techniques.  The  statistical  approach  used  here  recognizes  that  any  values  obtained 
are  governed  by  an  uncertainty  distribution.  The  fundamental  premise  of  this  work 
is  that  any  reflectance  result  is  also  governed  by  a  statistical  distribution,  and  the 
purpose  of  the  method  presented  is  to  determine  both  the  magnitude  and  trace- 
ability  of  error  as  it  moves  through  the  system,  accumulating  in  the  final  spectral 
reflectance  result.  The  final  product  of  the  process  is  a  basic  statistical  description 
of  the  final  result  in  reflectance  units.  This  chapter  presents  the  results  of  error 
propagation  process  at  each  step,  building  to  a  final  body  of  reflectance  uncertainty 
results.  Validation  and  sensitivity  study  results  will  also  be  presented. 

Error  propagation  is  a  multi-step  process.  The  results  of  each  step  are  now 
presented  individually  so  as  to  provide  insight  into  the  implications  of  the  final 
results.  Figure  5.1  shows  how  the  components  are  combined  to  produce  retrieved 
reflectance  errors.  According  to  the  error  propagation  method  described  in  section 
4.4,  any  propagated  error  requires  both  a  system  sensitivity,  defined  by  the  mathe¬ 
matical  relationship  between  variables,  and  a  system  driver,  defined  by  the  injected 
error  input.  In  the  case  of  model  output  uncertainty,  the  atmospheric  partial  deriva¬ 
tives  (section  5.1)  are  driven  by  atmospheric  constituent  uncertainty  (section  5.2). 
The  errors  in  the  model  outputs  (L^,  L^,  ri,  and  T2)  are  shown  for  a  variety  of 
input  drivers  in  section  5.3.  Sensor  calibration  error  modeling  results  for  several 
representative  sensing  platforms  are  shown  in  section  5.4.  A  variety  of  results  for 
the  modeled  environmental  components  are  presented  in  section  5.5.  Finally,  fully 
combined  end-to-end  error  propagation  results  are  presented  in  section  5.6. 
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Figure  5.1:  Map  of  Component  Results 
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5.1  Atmospheric  partial  derivatives 

5.1.1  Step  size  selection 

Determining  the  partial  derivatives  was  a  two-step  proeess.  First,  the  proper  numer- 
ieal  derivative  step  size  for  eaeh  eonstituent  was  determined.  This  is  not  normally 
thought  to  be  a  hazardous  proeess,  but  if  done  incorrectly  it  could  lead  to  some 
serious  problems.  Step  size  determination  results  are  presented  fully  in  figures  5.2, 
5.3,  and  5.4  and  summarized  in  table  5.1.  These  plots  show  the  basis  for  choosing 
the  step  sizes  that  were  eventually  used  to  numerically  compute  the  first  derivatives 
of  each  model  output  with  respect  to  each  atmospheric  parameter.  A  vertical  line 
on  the  plot  indicates  the  step  size  eventually  chosen  in  calculating  the  derivatives. 
A  single  number  was  used  for  all  bands  in  each  case.  The  different  plot  curves 
represent  a  sampling  of  wavelengths  between  400  nm  and  2500  nm,  roughly  300 
nm  apart. 


Table  5.1:  Partial  Derivative  Settings  Summary 


Parameler 

Selling 

wafer  vapor 

0.25  cm 

densily  allilude 

0.1  km 

visibility 

2  km 

Judgments  were  made  empirically,  keeping  in  mind  the  error  regime  consider¬ 
ations  illustrated  in  figure  4.7.  Bofh  fhe  funcfional  error  and  machine  noise  regimes 
are  clearly  visible  in  fhe  sfep  size  plofs.  Each  plof  is  besf  read  from  righf  fo  lefl  in 
fhaf  large  sfep  sizes  on  fhe  righf  are  generally  smoofhly  sloping  curves,  giving  way 
on  fhe  lefl  lo  more  erralic  behavior. 

Figure  5.2  shows  fhe  mosl  inferesling  behavior,  clearly  highlighling  fhe  po- 
lenlial  pilfalls  in  conducting  a  numerical  analysis  of  Ihis  sorl.  Several  effecfs  are 
visible:  highly  erralic  machine  noise  in  figure  5.2(a),  zig-zag  behavior  in  same, 
highly-sloping  functional  noise,  and  whal  appears  lo  be  Ihree  dislincl  slope  regimes 
punclualed  by  a  disconlinuily  jusl  under  1 .0  cm  sfep  size.  Machine  noise  regimes 
and  zig-zag  lines  also  appear  in  figures  5.3  and  5.4. 

The  highly  erralic  machine  noise  in  all  of  fhe  ri  derivalive  plofs  slems  from 
how  Ti  is  calculaled  from  fhe  MODTRAN  resulls.  If  is  fhe  only  resull  nol  direclly 
available  as  a  scaled  difference  of  lape  7  columns.  If  is  found  as  a  quolienl  of 
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columns,  meaning  it  is  highly  sensitive  to  machine  noise. 

The  zig-zag  behavior  was  investigated  and  found  to  be  a  quantization  issue.  Be¬ 
cause  the  default  MODTRAN  output  is  limited  to  a  set  number  of  decimal  places, 
it  is  possible  for  two  slightly  differing  inputs  to  produce  output  whose  values  dif¬ 
fer  by  an  amount  smaller  than  the  3  or  4  decimal  output  precision.  The  expected 
result  is  that  the  slope  is  constant  in  this  small  change  regime  because  outputs  and 
inputs  change  by  about  the  same  amount,  no  matter  what  they  are.  However,  when 
the  slopes  are  calculated  from  this  output,  the  unchanging  output  is  divided  by  the 
changing  input,  producing  a  different  slope.  Once  the  sub-precision  residual  accu¬ 
mulates  past  the  quantization  limit,  the  least  significant  decimal  place  increments 
(or  decrements),  and  the  quotient  suddenly  changes,  producing  a  step  discontinuity. 
The  entire  process  repeats,  creating  a  zig-zag  appearance.  From  an  error  propaga¬ 
tion  standpoint,  all  of  these  answers  are  “correct”  because  the  distance  between 
max  and  min  is  bounding  the  quantization  noise.  Technically  speaking,  it  is  prob¬ 
ably  most  correct  to  use  one  of  the  zig-zag  extrema  as  a  reference  value,  but  the 
results  need  to  be  examined  manually  to  determine  which  extremum  to  use. 

The  most  peculiar  aspect  of  the  water  vapor  step  size  graph  is  the  appearance 
of  3  different  behaviors:  a  typical  functional  noise  sloped  region  on  the  left,  a 
scalloped  region  in  the  middle,  and  a  opposite- sloping  discontinuity  on  the  right. 
This  is  most  likely  explained  by  how  MODTRAN  handles  excess  water  in  con¬ 
structing  its  profiles.  The  model  uses  fhe  1976  Sfandard  Afmosphere  because  if 
is  fhe  basis  for  correlafing  changes  in  femperafure  and  pressure  wifh  densify  alfi- 
fude.  However,  fhe  midlafifude  summer  vapor  profile  is  used  fo  heller  malch  welfer 
condilions  expecfed  in  fhe  US  norfheasl.  The  key  difference  is  lhal  despile  similar 
femperafure  and  pressure  profiles,  each  model  afmosphere  has  a  differenl  saluralion 
limil,  wifh  midlafifude  summer  saluraling  al  4.95799  glow?  and  fhe  1976  sfandard 
afmosphere  saluraling  al  2.61107  glcvr? .  If  is  likely  fhe  disconlinuilies  arise  from 
MODTRAN  reading  unprediclably  in  response  lo  approaching  Ihis  limit. 

Final  step  size  selection  attempted  to  find  fhe  place  lhal  optimally  avoids  fhe 
worsl  error  of  fhe  many  sources  discussed.  Primarily,  fhe  limil  was  placed  al  fhe 
oufer  edge  of  fhe  machine  noise  regime.  A  single  number  was  selected  for  each 
consliluenf,  and  because  seleclion  was  dominafed  by  machine  and  quanlizalion 
noise,  if  is  believed  lhal  Ihis  number  should  be  viable  for  many  differenl  geomelric 
configurations. 

5.1.2  Slope  determination  in  MODTRAN  functional  space 

The  parlial  derivalives  of  each  modeling  oulpuf  wifh  respecl  fo  each  almospheric 
consliluenf  are  absolulely  crucial  lo  fhe  functioning  of  fhe  error  propagation  model. 
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Figure  5.2:  Water  vapor  slope  step  size  sensitivity.  Each  curve  represents  one  wavelength  chosen  to 
sample  the  entire  spectral  range  on  50  nm  centers,  i.e.  400,  450,  . . . ,  2450,  2500  nm.  The  purpose 
of  the  plot  is  to  show  in-family  behavior  for  all  curves  in  relation  to  the  chosen  step  size  (the  vertical 
black  line),  so  individual  identification  of  each  curve  is  not  important.  The  functional  error  regime 
is  visible  as  a  slope  change  at  the  extreme  right  of  each  plot,  and  the  machine  error  regime  is  visible 
as  erratic  slope  behavior  on  the  extreme  left  of  each  plot. 
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Figure  5.3:  Altitude  slope  step  size  sensitivity.  Each  curve  represents  one  wavelength  chosen  to 
sample  the  entire  spectral  range  on  50  nm  centers,  i.e.  400,  450,  . . . ,  2450,  2500  nm.  The  purpose 
of  the  plot  is  to  show  in-family  behavior  for  all  curves  in  relation  to  the  chosen  step  size  (the  vertical 
hlack  line),  so  individual  identification  of  each  curve  is  not  important.  The  functional  error  regime 
is  visible  as  a  slope  change  at  the  extreme  right  of  each  plot,  and  the  machine  error  regime  is  visible 
as  erratic  slope  behavior  on  the  extreme  left  of  each  plot. 
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Figure  5.4:  AerosoFVisibility  slope  step  size  sensitivity.  Each  curve  represents  one  wavelength 
chosen  to  sample  the  entire  spectral  range  on  50  nm  centers,  i.e.  400,  450, . . . ,  2450,  2500  nm.  The 
purpose  of  the  plot  is  to  show  in-family  behavior  for  all  curves  in  relation  to  the  chosen  step  size 
(the  vertical  black  line),  so  individual  identification  of  each  curve  is  not  important.  The  functional 
error  regime  is  visible  as  a  slope  change  at  the  extreme  right  of  each  plot,  and  the  machine  error 
regime  is  visible  as  erratic  slope  behavior  on  the  extreme  left  of  each  plot. 
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Although  they  are  not  intuitively  eomprehensible  by  themselves,  they  are  what 
essentially  “earry”  error  inputs  forward  through  the  model  to  the  next  stage.  It 
would  be  tempting  to  eall  them  meaningless  as  standalone  results,  but  beeause 
they  represent  the  inner  workings  of  the  error  propagation  model  and  represent  a 
signiheant  portion  of  the  new  teehnique  presented  in  this  researeh,  they  deserve 
some  serutiny. 

The  slope  eomputation  results  are  shown  in  figures  5.5  through  5.8.  These 
eurves  are  speeifie  to  the  initial  eonditions  listed  in  tables  4.1,  4.2,  and  4.3,  but 
they  are  independent  of  any  error  seenarios.  Thus,  they  are  the  last  applieation- 
independent  results  that  will  be  presented. 

It  needs  to  be  pointed  out  that  both  visibility  and  aerosol  optieal  depth  (at  550 
nm)  are  presented  together.  Visibility  is  direetly  relatable  to  optieal  depth  via  an 
exponential  relationship.  The  exaet  relationship  applieable  to  the  baseline  geo- 
metrie  and  atmospherie  modeling  parameters  seleeted  for  the  sample  seenarios  is 
shown  in  figure  5.9.  In  fhe  figure,  fhe  baseline  15  km  visibilify  eorresponds  fo  an 
opfieal  depfh  of  0.447.  Visibilify  is  an  infuifive,  single-paramefer  inpuf  fo  MOD- 
TRAN  (given  an  aeeepfable  defaulf  aerosol  model),  whereas  direef  aerosol  defini- 
fion  is  nof.  Aerosol  opfieal  depfh  (af  550  nm)  is  available  in  fhe  oufpuf,  Iherefore 
bofh  inpufs  produee  aeeepfable  parfial  derivafives.  Visibility,  however,  is  a  terrible 
quantify  fo  measure,  fhe  reasons  for  whieh  will  be  elaborated  upon  in  seefion  5.2.1. 
Aerosol  opfieal  depfh  is  used  as  fhe  working  quanfify  after  fhis  poinf. 

The  absolufe  magnifudes  of  fhe  parfial  derivafives  are  nof  useful  for  eomparison 
purposes  beeause  fhey  are  of  differenl  unifs  wifh  differenl  fypieal  values.  In  figure 
5.5,  fhe  parfial  derivafive  of  n  wifh  respeef  fo  aerosol  opfieal  fhiekness  is  mueh 
larger  fhan  fhe  parfial  wifh  respeef  fo  visibilify  beeause  fhe  fypieal  variabilify  of 
AOT  is  fwo  orders  of  magnifude  less  fhan  fhaf  of  visibilify. 

As  would  be  expeefed,  figure  5.5  elosely  mafehes  5.6.  Beeause  fhe  time  of 
day  is  near  loeal  noon,  n  should  be  nearly  idenfieal  fo  T2.  Nofe  fhe  signs  of  fhe 
eurves  wifh  respeef  fo  wafer  vapor  and  aerosols  are  opposite  fhose  wifh  respeef 
fo  visibilify  and  alfifude.  This  is  due  fo  fhe  faef  fhaf  fransmissivify  inereases  wifh 
higher  visibilify  and  alfifude  (less  seaflerers)  and  deereases  wifh  higher  wafer  vapor 
and  aerosols  (more  seafferers).  An  exeepfion  fo  fhis  observation  oeeurs  wifh  wafer 
vapor  in  fhe  low  visible  wavelengfhs,  where  if  is  fhoughf  fhaf  fhe  wafer  vapor’s 
lower-fhan-air  densify  sfarfs  fo  emerge  as  a  more  dominanf  effeef.  Figures  5.7  and 
5.8,  bofh  seaffered  radianee  resulfs,  share  fhe  same  general  fendeneies  buf  differ  in 
magnifude. 

All  eurves  are  poeked  wifh  absorpfion  dips  (and  spikes,  in  fhe  ease  of  wafer 
vapor).  If  should  be  noted  fhaf  fhe  apparenf  low  sensifivify  in  fhese  regions  is 
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Partial  derivatives  for  taul 


Figure  5.5:  Derived  slopes  for  ri  with  respect  to  each  constitutent 


Partial  derivatives  for  tau2 


Figure  5.6:  Derived  slopes  for  T2  with  respect  to  each  constitutent 
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Partial  derivatives  for  Ld 


Figure  5.7:  Derived  slopes  for  with  respect  to  each  constitutent 


Partial  derivatives  for  Lu 


Figure  5.8:  Derived  slopes  for  Lu  with  respect  to  each  constitutent 
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Aerosol  Optical  Depth  vs  Visibility 


Visibility  (km) 


Figure  5.9:  Relationship  between  aerosol  optical  depth  and  visibility.  The  plot 
shown  here  uses  default  MODTRAN  aerosol  settings  and  the  geometric  settings 
listed  in  table  4.1.  Optical  depth  is  indexed  to  a  particular  wavelength,  com¬ 
monly  550  nm.  Other  parameters  are  required  to  describe  the  spectral  character 

of  aerosols’  effect. 


counterbalanced  by  the  low  signal  and  high  noise  in  the  actual  radiance  curves, 
removing  any  hope  of  useful  results  in  these  regions. 

5.2  Atmospheric  constituent  uncertainty 

The  other  half  of  error  propagation  is  the  atmospheric  constituent  uncertainty  be¬ 
ing  propagated  forward.  The  three  sources  referenced  by  figure  5. 1  are  climatology, 
instruments,  and  inversion  algorithms,  each  one  providing  atmospheric  constituent 
inputs  to  MODTRAN.  The  constituents-water  vapor,  well  mixed  gas  density,  and 
aerosol  optical  depth-are  known  to  varying  degrees  of  certainty.  These  uncertain¬ 
ties  were  reduced  to  the  standard  deviation  of  a  normal,  uniform,  or  log-normal 
distribution  (depending  on  the  observed  physical  phenomenology),  so  as  far  as  the 
error  propagation  model  is  concerned,  they’re  all  just  numbers.  However,  each 
source  was  selected  to  illustrate  a  specific  point,  which  will  be  discussed  before 
combining  the  constituent  uncertainties  with  the  partial  derivatives  to  produce  re¬ 
flectance  error  predictions. 
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5.2.1  Constituents  from  Climatology 

It  was  proposed  that  modeling  eould  be  attempted  without  a  priori  knowledge  us¬ 
ing  an  approaeh  ealled  “blind  modeling.”  Often  atmosphere  modeling  is  used  to 
support  imaging  researeh  without  mueh  eonsideration  of  how  using  MODTRAN’s 
default  values  (“very  blind  modeling,”  perhaps)  and  the  midlatitude  summer  at¬ 
mosphere  really  ehange  the  results,  though  that  is  eertainly  “better  than  nothing.” 
The  use  of  loeal  historieal  data  also  falls  within  the  “better  than  nothing”  eategory 
but  provides  modeling  settings  that  eould  plausibly  be  believed  to  have  degree  of 
eloseness  to  aetual  eonditions.  The  results  presented  here  show  that  a  elimatology 
approaeh  to  eonstituent  error  produees  a  viable  result  that  will  be  used  in  forward 
propagation.  These  propagated  errors  will  be  eompared  to  results  from  the  other 
sourees  of  eonstituent  uneertainty. 

Historieal  elimate  data  were  eompiled  and  analyzed  for  Buffalo  Niagara  Inter¬ 
national  Airport,  whieh  benefits  from  several  eolloeated  data  eolleetion  aetivities. 
Airport  observations,  twiee-daily  radiosonde  launehes,  and  a  nearby  automated 
GPS  water  vapor  station  were  all  investigated  for  suitability.  Table  5.2  summarizes 
the  results  of  the  elimate  study,  with  the  results  themselves  shown  in  Appendix  B 
starting  on  page  201. 

The  results  themselves  are  straightforward  to  interpret  with  some  minor  diseus- 
sion  warranted.  First,  the  results  were  aggregated  by  month.  This  was  an  arbitrary 
decision  chosen  so  as  to  capture  seasonal  cycles.  Further  aggregation  by  time  of 
day  was  also  desired,  but  the  observations  were  thought  to  be  insufficient  to  sup¬ 
port  this.  Table  5.2  only  shows  results  for  May,  which  corresponds  to  the  baseline 
geometry  listed  in  table  4. 1 .  A  second  discussion  point  in  these  results  is  that  visi¬ 
bility  observations  cannot  be  used  as  a  source  measurement  for  reasons  exposed  by 
figure  B.9.  Visibilify  observafions  af  an  airporf  exisf  fo  defecf  condifions  fhaf  may 
inferfere  wifh  fakeoffs  and  landings.  Thus,  fhey  are  af  leasf  bimodal,  wifh  low-end 
resulfs  caused  by  weafher  and  high-end  resulfs  caused  by  haze,  fhough  fhis  could 
be  fixed  by  fruncafing  fhe  lowesf  observafions.  However,  airporf s  also  do  nol  care 
abouf  fhe  visibilify  if  if  exceeds  10  or  15  km.  Indeed,  figure  B.9  shows  a  parfial  dis- 
fribufion  fail  where  mosf  of  fhe  clear-weafher  observafions  are  all  binned  af  10  km 
rafher  fhan  made  more  accurafely.  Simply  puf,  aerosols  musf  be  measured  direcfly 
in  order  fo  supporf  remofe  sensing  operafions. 

This  secfion  does  nof  fully  explore  fhe  many  inferesfing  nuances  discovered 
when  using  fhese  dafa  sources  for  blind  modeling;  fhe  main  poinf  here  is  fhaf  fhese 
should  not  be  used.  Table  5.8  shows  fhe  uncerfainfy  here  is  generally  10  x  as 
large  as  any  of  fhe  ofher  dafa  sources  used  here.  This  bound  on  fhe  “beffer-lhan- 
nofhing”  opfion  is  an  imporfanf  resulf,  considering  ifs  prevalence  in  supporf  fo 
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imaging  science  research  (though  if  no  other  alternative  exists,  be  sure  to  do  it  in 
winter).  Propagated  results  will  be  shown  starting  in  section  5.3. 


Table  5.2:  Climatology  Results  Summary  (Month  5) 


Parameter 

Source 

Mean  value 

Std  deviation 

Eigure 

water  vapor 

GPS 

1.87  cm 

1.06  cm 

B.l 

radiosonde 

1.90  cm 

1.07  cm 

B.2 

MODIS 

1.55  cm 

0.62  cm 

B.3 

density  altitude 

airport  obs 

0.21  km 

0.21  km 

B.4 

GPS  synoptic 

0.17  km 

0.18  km 

B.5 

radiosonde 

0.16  km 

0.22  km 

B.6 

aerosol  optical  depth 

MODIS 

0.37 

0.39 

B.7 

5.2.2  Constituents  from  Instrumentation 

As  stated  earlier,  wireless  communication  enabling  a  potential  paradigm  shift  where 
the  previously  impractical  routine  use  of  ground  truth  in  remote  sensing  could  be¬ 
come  practical.  A  snapshot  of  the  state  of  instrumentation  uncertainty  was  obtained 
through  a  cursory  catalog  search  and  a  dip  into  the  body  of  information  compiled 
by  the  Atmospheric  Radiation  Measurement  (ARM)  Program,  a  Department  of  En¬ 
ergy  activity  that  operates  a  national  infrastructure  of  highly  instrumented  ground 
stations  (U.S.  Department  of  Energy,  2004).  The  primary  metric  was  the  published 
uncertainty  provided  by  each  type  of  sensor,  which  was  taken  at  face  value  (despite 
the  obligatory  warnings  about  trusting  manufacturer’s  claims). 

Tables  5.3  through  5.6  comprise  a  brief  re-compilation  of  some  of  this  data. 
It  does  not  need  to  be  comprehensive;  as  long  as  each  constituent  is  covered  by 
an  instrument  that  can  be  described  as  typical  of  the  field,  then  the  purpose  will 
be  served.  The  measurement  atmospheric  quantities  as  ground  truth  is  an  incred¬ 
ibly  important  capability,  and  the  performance  of  a  instrument  network-enhanced 
sensing  result  is  based  on  the  capabilities  inherent  in  these  instruments. 

Density  altitude  is  an  indirect  measurement  designed  to  index  well-mixed  gas 
density.  Altitude  itself  is  indirectly  measured  through  pressure  and  two  types  of 
temperature  (both  air  temperature  and  dew  point).  In  an  operational  environment, 
the  three  measurements  are  taken  together.  Eor  the  purposes  of  the  results  to  follow, 
it  was  necessary  to  derive  density  altitude  uncertainty  by  propagating  uncertainty  in 
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pressure  and  temperature.  This  calculation  uses  the  baseline  scenario’s  values  for 
surface  temperature  and  pressure  but  a  monthly  historical  average  for  dew  point. 

A  brief  survey  was  conducted  to  determine  the  state  of  the  industry  with  re¬ 
gards  to  ground  instrument  accuracy  in  sensing  quantities  of  interest:  tempera¬ 
ture,  pressure,  aerosol  optical  depth,  and  integrated  water  vapor  column  height. 
This  sampling  of  uncertainty  values  will  form  the  foundation  for  error  propagation 
analysis  of  ground  truth  networks.  At  this  point,  no  consideration  is  given  to  cost 
or  practicality,  just  possibility.  Results  are  summarized  in  tables  5.3  through  5.6. 
In  addition  to  the  atmospheric  measurement  data,  Michalsky  (2001)  notes  pyra- 
nometer  and  shadowband  radiometer  irradiance  accuracy  as  low  as  3%  for  direct 
irradiance  and  5%  for  diffuse  irradiance  after  non-linearity  correction.  This  ground 
instrument  uncertainty  will  be  used  to  predict  incorporation  of  direct  measurement 
of  downwelled  radiance,  sun-ground  transmission,  and  ground-reaching  radiance 
into  uncertainty  reduction. 


Table  5.3:  Temperature 


Source 

Uncerfainfy 

Source 

Commercial  weafher  sfafion 

0.5°  C 

Davis  Insfrumenfs  (2004) 

NIST  reference  insfrumenf 

0.2°  C 

Davis  Insfrumenfs  (2005) 

Vaisala  RS-90 

0.5°  C 

Vaisala  (2006) 

Vaisala  RS-90  dew  poinf 

1.5°  C 

ibid. 

Vaisala  PTU300 

0.2-0.4°  C 

Vaisala  (2008) 

GPS  MET  sfafion 

0. 1-0.3°  C 

Feng  and  Herman  (1999) 

5.2.3  Constituents  from  In-scene  Algorithms 

The  final  source  for  uncertainty  in  a  model-based  approach  comes  from  the  in¬ 
scene  model-based  algorithms  themselves.  As  described  in  sections  3.2.2  and 
3.2.3,  in-scene  algorithms  depend  on  band  ratio  methods  to  determine  atmospheric 
constituents.  Because  inversion  algorithm  validation  studies  rightly  focus  on  final 
reflecfance  resulfs  and  seldom  on  fhe  infermediafe  resulfs  of  fhe  algorifhm’s  inner 
workings,  band  rafio  sfudies  provide  fhe  majorify  of  fhe  uncerfainfy  dafa  used  fo 
populafe  fhis  source. 

The  correlafion  befween  band  rafio  and  physical  phenomenology  is  derived  by 
consfrucfing  look-up  fables  wifh  MODTRAN.  The  degree  of  error  inherenf  in  fhe 


ATMOSPHERIC  CONSTITUENT  UNCERTAINTY 


117 


Table  5.4:  Pressure 


Souree 

Uneertainty 

Souree 

Commereial  weather  station 

1.35  hPa 

Davis  Instruments  (2004) 

NIST  referenee  instrument 

0.68  hPa 

Davis  Instruments  (2005) 

Vaisala  RS-90 

1.0  hPa 

Vaisala  (2006) 

Vaisala  PTU300 

0.15-0.45  hPa 

Vaisala  (2008) 

Vaisala  PTBIOO 

0.25-0.3  hPa 

Deblonde  et  al.  (2005) 

Setra  270  pressure  transdueer 

0.3  hPa 

ibid. 

GPS  MET  w/  synoptie  meas. 

0.66-1.4  hPa 

ibid. 

GPS  MET  station 

0.13-0.44  hPa 

ibid. 

Table  5.5:  Aerosol  Optieal  Depth 


Souree 

Uneertainty 

Souree 

Cimel  Sunphotometer 

0.02-0.04 

Rainwater  and  Gregory  (2005) 

S  unphotometer  -  high  altitude 

0.01 

Halthore  et  al.  (1999) 

Multifilter  rotation  shadowband 
radiometer  (MERSR) 

0.02 

ibid. 
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process  is  the  basis  for  a  common  comparison  with  other  sources  for  atmospheric 
constituent  data.  This  is  not  a  bad  comparison  because  the  same  assumptions  that 
underly  the  main  mathematical  techniques  of  the  work  presented  herein  mirror 
those  used  to  construct  the  lookup  tables.  Both  rely  on  linearizing  a  smooth  curve 
pegged  to  a  certain  set  of  geometric  conditions,  so  the  error  inherent  in  the  cor¬ 
relation  process  theoretically  matches  the  functional  error  inherent  in  the  slope 
determination  process,  which  was  too  low  to  affect  the  results. 

Therefore,  error  arising  from  the  band  ratio  process  is  not  inherent  in  the  pro¬ 
cess  itself,  rather  it  arises  from  imperfect  modeling  of  the  atmosphere  under  test. 
It  is  further  concluded  that  this  imperfect  modeling  is  not  related  to  the  variables 
treated  by  the  algorithm,  instead  it  is  the  assumed  variables  that  are  never  verified. 
One  example  of  this  is  provided  by  Gao  and  Goetz  (1993),  where  the  presence  of 
liquid  water  fouls  the  in-scene  water  vapor  determination  method  and  subsequent 
spectral  curve  fit.  The  idea  that  an  error  in  the  assumed  aerosol  particle  size  distri¬ 
bution  could  manifest  as  error  in  retrieved  water  vapor  (for  example)  presents  an 
interesting  implication  for  the  comparisons  made  here.  It  suggests  that,  for  model 
based  algorithms  only,  constituent  determination  error  may  not  cause  random  error 
in  reflectance,  instead  it  manifests  as  a  bias  due  to  a  shift  in  the  entire  function 
space  (that  may  or  may  not  be  linear  across  the  entire  parameter  range).  Linearity 
problems  with  band  ratio  algorithms,  like  those  described  by  Hirsch  et  al.  (2001), 
may  also  contribute.  It  is  entirely  possible  that  this  underlies  the  empirical  EF¬ 
FORT  correction  described  by  Boardman  (1998).  Modeling  error  due  to  bias  as 
a  random  phenomenon  potentially  invalidates  the  approach  by  which  ground  truth 
instrument  errors  are  directly  compared  to  errors  observed  in  the  in-scene  inversion 
process.  Put  another  way,  it  is  possible  that  because  of  the  many  effects  built  into 
FFAASH’s  lookup  table,  perfect  knowledge  of  the  constituents  FFAASH  finds 
would  still  resulf  in  refrieved  rellecfance  errors.  However,  since  fhe  inner  work¬ 
ings  of  fhe  model  based  algorifhms  are  beyond  fhe  scope  of  fhis  sfudy,  fhis  fheory 
will  need  fo  be  explored  in  fufure  work.  Errors  related  fo  model-based  inversion 
algorifhms  are  freafed  as  random  if  reported  as  such. 

According  fo  Green  ef  al.  (1993),  surface  pressure  alfifude  appears  fo  closely 
follow  fhe  fopography  of  fhe  region.  This  mighf  suggesf  fhaf  barring  drastic  ex- 
fremes  of  weafher,  acfual  ferrain  elevation  is  more  imporfanf  fhan  elevafion  ad¬ 
justed  for  non-sfandard  air  column  densify.  As  an  example,  given  a  surface  heighf 
of  220  mefers,  an  afmospheric  variation  confribufion  of  5-10  mefers  is  really  wifhin 
fhe  noise  of  fhe  surface  elevafion  measuremenf  in  fhe  firsf  place.  Figure  4.10  shows 
fhaf  for  flal  ferrain,  elevafion-only  error  is  generally  bounded  fo  10  mefers  or  less. 
Drasfic  ferrain  changes  would  have  slighfly  higher  error,  and  mosf  of  fhe  area  cov- 
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ered  by  the  DEM  would  likely  have  signifieantly  less.  This  makes  10  meters  a 
eonservative  value  to  use  for  the  determination  of  density  altitude. 

Alternately,  Green  (1991)  also  notes  that  in-seene  altitude  determination  was 
preeise  to  within  12%  when  performed  pixel-by-pixel.  Results  were  improved 
when  multiple  pixels  were  eonvolved  together,  presumably  under  the  assumptions 
that  density  altitude  slowly  varies  spatially  and  that  high-frequeney  differenees  un¬ 
related  to  the  equivalent  elevation  eould  be  safely  removed  to  obtain  a  better  loeal 
result.  Using  12%  as  an  upper  bound,  with  the  understanding  that  the  preeision  for 
a  spatially  averaged  in-seene  determination  should  be  somewhat  lower,  an  altitude- 
dependent  uneertainty  range  of  1-25  meters  is  assumed. 

Beeause  in-seene  determination  of  atmospherie  water  vapor  employs  the  use  of 
a  band  ratio  teehnique,  it  is  possible  to  evaluate  algorithm  performanee  in  this  re¬ 
gard  by  examining  the  results  of  band  ratio  studies.  A  study  performed  to  validate 
the  AVIRIS  water  vapor  retrieval  method  produeed  very  useful  results  (Bruegge 
et  al.,  1990).  It  was  based  on  synoptie  eolleetions  using  very  preeise  ground  instru¬ 
ments  and  a  LOWTRAN-assisted  band  ratios  algorithm.  The  benefit  is  that  very 
preeise,  upward-looking  instruments  ean  determine  the  theoretieal  limit  of  band 
ratio  reliability  free  of  the  need  to  aeeount  for  instrument  noise  and  ground  eon- 
stituents  affeeting  what  is  assumed  to  be  an  atmosphere-only  phenomenon.  Sun- 
photometer  and  speetral  hygrometer  measurements  were  used  to  produee  ratios  that 
were  then  indexed  against  LOWTRAN  predietions.  Both  types  of  ratios  used  the 
940  nm  absorption  feature.  These  results  were  eross-eheeked  by  a  Fourier  trans¬ 
form  speetrometer,  agreeing  with  one  another  to  within  2%.  When  used  to  support 
an  AVIRIS  eolleetion,  the  results  displayed  random  deviations  restrieted  to  within 
0.05  em.  Although  these  results  will  not  be  direetly  applieable  to  a  downward¬ 
looking  retrieval  with  an  imaging  speetrometer,  this  provides  the  lower  bound  of 
error  but  does  not  provide  typieal  performanee  for  in-seene  algorithms.  One  result 
that  eould  be  direetly  applieable  is  that  an  AVIRIS  retrieval  was  also  thought  to 
have  an  uneertainty  of  0.05  em.  The  study  was  eondueted  in  a  dry  atmosphere,  so 
the  entire  range  eited  here  is  for  the  “dry”  eategory  of  uneertainty  predietions. 

The  band  ratio  algorithm  that  eventually  beeame  part  of  the  ATREM  inversion 
algorithm  (Gao  and  Goetz,  1990b)  and  that  used  by  the  AVIRIS  inversion  algo¬ 
rithm  (Bruegge  et  al.,  1990)  both  use  a  eontinuum  interpolated  band  ratio  (CIBR) 
to  determine  feature  absorption  depth  and  eorrelate  it  to  water  vapor  abundanee. 
One  eomprehensive  study  of  ClBR’s  performanee  was  eondueted  by  Hirseh  et  al. 
(2001).  This  study  examined  the  baseline  CIBR  model,  repeated  in  equation  5.1, 
where  is  the  radianee  at  the  bottom  of  the  feature  (at  approximately  940  nm), 
and  Li  and  L2  are  the  radianees  at  the  shoulders  of  the  feature.  The  wavelength 
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terms  correspond  to  the  points  at  which  these  three  radiances  are  taken  and  are  used 
to  perform  the  interpolation  from  shoulder  to  shoulder  so  as  to  estimate  what  the 
radiance  should  be  for  a  zero-water  vapor  case. 


CIBR 


Lp 


Af— Ai 
A2— Ai 


Li  + 


A2  — Af 
A2  — Ai 


L2 


(5.1) 


The  baseline  CIBR  results  were  compared  with  a  scene  reflectance-corrected 
modified  CIBR  and  Atmospheric  Pre-corrected  Differential  Absorption  (APDA) 
water  vapor  retrieval  algorithm.  The  scene  reflectance  correction  arises  from  an 
empirical  observation  that  band  ratios  over  dark  targets  are  negative  affected  by 
upwelled  radiance,  whereas  the  higher  reflected  radiance  bright  targets  tends  to  pre¬ 
vent  path  radiance  from  exerting  dominance  over  the  relevant  spectral  region.  The 
same  idea  motivates  APDA,  where  a  path  radiance  correction  attempts  to  remove 
the  same  effect,  but  in  a  way  that  should  make  the  target  reflectance  irrelevant.  The 
APDA  model  is  given  as  equation  5.2,  where  the  L„  terms  represent  the  upwelled 
radiance  terms  for  the  corresponding  spectral  band.  APDA  requires  iteration.  All 
methods  in  this  study  looked  at  the  940  nm  absorption  feature. 


APDA 


Af  — Ai 
A2  — Ai 


(Li 


Lp  ^u,F 

Lu,i)  +  ^{L2-Lu,2) 


(5.2) 


The  CIBR  study  presented  by  Hirsch  et  al.  (2001)  compiled  a  wide  array  of 
validation  data,  where  in-scene  band  ratios  derived  from  Multispectral  Thermal 
Imager  (MTI),  and  validation  data  were  obtained  from  radiosondes  and  sun  pho¬ 
tometers  located  at  several  sites.  The  data  are  presented  in  figure  5.10. 

CIBR  and  APDA  produced  accurate  dry-atmosphere  predictions  but  underes¬ 
timated  to  varying  degrees  the  water  vapor  in  wet  atmospheres.  The  study  results 
were  reduced  by  calculating  the  root  mean  squared  error  for  each  band  ratio  esti¬ 
mate  compared  to  the  corresponding  ground  truth  measurement.  Readings  taken 
from  different  altitudes  were  removed.  The  divergence  observed  for  wetter  at¬ 
mospheres  is  unsettling.  It  is  possible  that  ground  truth  instruments  perpetually 
overestimate  water  vapor  content,  but  it  has  been  noted  that  some  algorithms  have 
problems  with  high  water  vapor  content  (Goetz  et  ah,  2003),  suggesting  the  prob¬ 
lem  does  not  lie  with  the  truth  instruments.  It  is  more  likely  that  feature  depth 
is  underpredicted  by  MODTRAN,  a  phenomenon  that  was  surely  validated  at  one 
point  and  therefore  deserves  greater  scrutiny  in  the  future.  Another  possibility  may 
be  tied  to  how  MODTRAN  processes  wet  atmospheres.  Each  of  the  built-in  models 
has  an  internal  maximum  water  vapor  content  it  can  accommodate,  and  only  two  of 
six  are  capable  of  taking  greater  than  3  cm  of  integrated  precipitable  water  vapor. 
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Table  5.6:  Water  Vapor 


Source 

Uncertainty 

Source 

Aeronet  microwave  radiometer 

0.02-0.04  cm 

Cimini  et  al.  (2003) 

Aeronet  microwave  radiometer 

0.023  cm 

Eiljegren  and  Eesht  (1996) 
Revercomb  et  al.  (2003) 

ROAB  sonde/GPS  cross-cal 

0.1  cm 

Mattioli  et  al.  (May  2005) 

ARM  CART  sonde/GPS  cross-cal 

0.2  cm 

Santos  et  al.  (2007) 

GPS-MET  network  IPW  -  dry 

0.1  cm 

Deblonde  et  al.  (2005) 

GPS-MET  network  IPW  -  wet 

0.2  cm 

ibid. 

International  H20  Project  GPS  IPW 

0.15  cm 

Birkenheuer  and  Gutman  (2005) 

Australian  GPS  net/MWR  cross-cal 

0.13-0.24  cm 

Santos  et  al.  (2007) 

Cimel  S  unphotometer 

10% 

(Rainwater  and  Gregory,  2005) 
(Halthore  et  al.,  1999) 

Regan  Sunphotometer 

12% 

(Bruegge  et  al,  1990) 

Spectral  Hygrometer 

0.01  cm 

ibid. 
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Figure  5.10:  CIBR  and  APDA  validation  results 
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Additionally,  MODTRAN  has  a  separate  procedure  for  vertically  redistributing  wa¬ 
ter  vapor  in  response  to  layer  saturation,  which  may  produce  unexpected  results. 
Work  by  Felde  et  al.  (2004)  provides  what  is  probably  the  best  insight  into  this  is¬ 
sue:  the  band  ratios  for  the  820  nm,  940  nm,  and  1130  nm  water  vapor  absorption 
regions  all  lose  sensitivity  above  approximately  2.5  cm  of  total  water  vapor.  Put 
another  way,  retrieved  water  vapor  is  hypersensitive  to  small  perturbations  to  band 
ratio.  The  above  mentioned  factors  likely  combine  to  produce  small  errors  in  band 
ratio  that  magnify  errors.  This  presents  another  opportunity  for  future  validation 
of  the  predicted  versus  observed  behavior  of  atmospheres  with  high  water  vapor 
content. 

CIBR  produced  an  uncertainty  of  0.11  cm  for  dry  atmospheres  and  1 .23  cm 
for  wet.  After  removing  instances  where  APDA  failed  to  produce  a  convergent 
solution,  the  algorithm  gave  an  uncertainty  of  0.12  cm  and  1.29  cm,  respectively. 
For  both  algorithms,  the  wet  atmosphere  uncertainty  appears  to  include  a  non¬ 
linear  bias,  so  these  deviations  should  not  be  treated  as  random.  An  empirical  fit 
to  the  data  was  determined,  visible  as  the  fit  lines  in  figure  5.10,  and  used  fo  de¬ 
bias  fhe  dafa  sef.  If  is  againsf  fhese  de-biased  values  fhaf  random  deviations  can 
be  compufed.  There  is  no  claim  made  fhaf  fhis  til  is  universal;  rafher,  if  simply 
fils  fhese  dafa  in  fhis  case.  Additional  dafa  could  continue  lo  follow  fhese  Irends 
or  Ihey  could  allernafely  display  complelely  random  behavior  around  fhe  1 : 1  rafio 
line.  Wilh  fhe  bias  correclion,  random  uncerfainly  for  fhe  wel  almosphere  cases  is 
0.35  for  CIBR  and  0.36  for  APDA. 

Several  olher  sources  offer  wafer  vapor  uncerlainlies  in  fhe  form  of  a  per- 
cenlage,  namely  Gao  and  Goelz  (1990b)  and  Kaufman  and  Gao  (1992).  The 
firsl  cites  approximalely  5%  error  for  a  scene  wilh  mean  0.97  cm  of  wafer  vapor, 
while  fhe  latter  demonslrales  13%  error  wilh  possible  improvemenls  fhaf  reduce 
if  lo  7%.  In  order  lo  Iranslale  fhese  info  a  range  in  cenlimelers  of  lolal  precip- 
ilable/inlegraled/perceived  water  vapor,  a  slandard  dry  almosphere  value  of  0.75 
cm  was  assumed,  and  a  slandard  wel  almosphere  wilh  2.0  cm  of  wafer  vapor  was 
assumed. 

In-scene  aerosol  opfical  deplh  is  accomplished  using  a  dark  pixel  melhod  fhaf 
provides  upwelled  radiance  as  an  indicator  of  scattering  species.  An  algorilhm 
of  fhis  type  was  developed  for  fhe  Moderale  Resolution  Imaging  Speclromeler 
(MODIS)  inslrumenl  on  NASA’s  Terra  spacecrafl  and  has  grown  info  widespread 
use  (Kaufman  el  ah,  1997).  The  algorilhm  relies  on  band  correlation  relationships 
for  low  refleclance  largels  to  estimate  Ihe  aerosol  conlribulion.  In  a  nulshell,  Ihe 
470  and  660  nm  visible  speclral  regions  were  found  to  correlate  in  largel  refleclance 
wilh  2.1  and  3.8  micron  speclral  regions.  In  Ihe  absence  of  olher  factors,  il  is  ex- 
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peeled  that  speetral  bands  at  or  near  these  loeations  will  eorrelate,  partieularly  for 
dark  targets.  The  benefit  is  that  aerosols  affeet  the  visible  region  mueh  more  than 
the  near  or  midwave  infrared  regions.  Additionally,  dark  targets  are  less  sensitive 
to  direet  radiation  and  highly  sensitive  to  upwelled  path  radianee,  whieh  is  heavily 
driven  by  aerosol  interaetions.  Therefore,  aerosol  abundanee  is  knowable  through 
the  degree  of  non-eorrelation  between  the  seleeted  visible  and  infrared  bands. 

The  published  uneertainty  is  Axa  =  0.05  ±  0.02  Tq,  where  Ta  is  used  by  the 
authors  to  denote  aerosol  optieal  thiekness.  The  uneertainty  from  this  algorithm 
is  tied  to  the  value  of  the  optieal  thiekness,  so  a  visibility  range  was  ehosen  and 
eonverted  to  an  exponent.  10  km  is  used  as  the  low  visibility  ease,  ehosen  based 
on  elimatology  analysis  presented  earlier.  This  is  the  lowest  typieal  value  not  en- 
eroaehing  on  weather  effeets.  An  upper  value  of  50  km  was  ehosen  to  be  arbitrarily 
large;  past  25  km,  the  ehange  in  optieal  depth  is  small  enough  that  any  large  value 
would  be  suitable.  At  50  km,  the  aerosol  optieal  depth  is  0.15,  and  at  10  km  it  is 
0.65.  At  these  points,  the  aerosol  uneertainty  range  beeomes  0.053-0.63. 

Table  5.7  summarizes  the  in-seene  retrieval  results.  Eaeh  souree  has  a  low  and 
high  estimate.  For  water  vapor  estimation,  the  low  estimate  is  for  a  dry  atmo¬ 
sphere,  and  the  high  is  for  a  relatively  humid  atmosphere.  As  stated  earlier,  for 
uneertainties  reported  to  be  a  funetion  of  water  vapor  eontent,  the  dry  atmosphere 
was  defined  as  0.75  em,  and  the  wet  atmosphere  was  defined  as  2.0  em.  For  den¬ 
sity  altitude,  the  low  and  high  uneertainties  eorrespond  to  low  and  high  altitude, 
roughly  defined  as  sea  level  and  300  km. 

Similar  fo  fhe  ofher  eonsfifuenfs,  aerosol  opfieal  depfh  has  low  and  high  es- 
fimafes  beeause  fhe  uneerfainfy  is  a  funelion  of  fhe  opfieal  fhiekness  ilself.  Fow 
uneerfainfy  eorresponds  fo  fhe  high  visibilify  ease  af  50  km,  and  high  uneerlainfy 
eorresponds  fo  fhe  low  visibilify  ease  af  10  km.  In  fhe  ease  of  alfifude,  a  eap 
was  plaeed  on  fhe  high  alfifude  beeause  fhe  ubiquitous  availabilify  of  low-error 
DEM  dafa,  even  for  high  alfifude  ferrain.  The  besf  in- family  uneerfainfy  values  for 
eaeh  afmospherie  eonsfifuenf  will  be  used  fo  eonsfruef  fwo  seenarios  simulafing 
a  model-based  algorifhm  drawing  upon  eaeh  of  fhese  in-seene  sourees  for  afmo- 
spherie  eonsfifuenfs. 

Alfhough  if  would  be  infuifive  fo  assume  low  alfifude  regions  are  humid  and 
hazy,  while  high  alfifude  regions  are  dry  and  elear,  no  sueh  assumption  was  made. 
Insfead,  fhe  “low  uneerfainfy”  seenario  uses  all  “low  uneerfainfy”  inpufs  and  vice 
versa.  In  frufh,  fhe  alfifude  uneerfainfy  eonfribufion  is  expeefed  fo  be  a  minor 
eonfribufor,  so  fhe  resulfs  probably  would  be  fine  under  eifher  pairing  seheme. 
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Table  5.7:  Inversion  algorithm  eonstituent  determination  summary 


Parameter 

Souree 

Uncertainty  range 
Fow  High 

source 

water  vapor 

FOWTRAN  band  ratio 

0.015 

0.05  cm 

Bruegge  et  al.  (1990) 

AVIRIS  retrieval 

0.05  cm 

- 

ibid. 

ATREM  preeursor 

0.04  cm 

0.1  cm 

Gao  and  Goetz  (1990b) 

CIBR  validation 

0.11  cm 

0.35  cm 

Hirsch  et  al.  (2001) 

APDA  validation 

0.12  cm 

0.36  cm 

ibid. 

MODIS  in-seene 

0.05  cm 

0.14  cm 

Kaufman  and  Gao  (1992) 

density  altitude 

terrain  dominance 

0.004  km 

0.01  km 

Green  et  al.  (1993) 

CIBR  (12%) 

0.001  km 

0.04  km 

Green  (1991) 

aerosols 

MODIS  validation 

0.053 

0.063 

Kaufman  et  al.  (1997) 

5.2.4  Atmospheric  Constituent  Scenarios 

An  overall  summary  of  the  atmospherie  eonstituent  sourees  is  given  in  table  5.8. 
Eaeh  line  on  the  table  will  be  used  as  the  starting  point  for  end-to-end  error  propa¬ 
gation  seenarios,  the  results  of  whieh  are  presented  in  seetion  5.3.  There  is  one 
seenario  based  on  elimatology,  two  on  ground  instrument  networks  of  varying 
quality,  and  two  on  in-seene  retrieval  algorithms.  These  last  2  seenarios  attempt 
to  simulate  how  a  model-based  algorithm  sueh  as  FLAASH  might  perform,  whieh 
assumes  that  eonstituent  retrieval  is  not  the  blaek-box  proeess  one  might  wish  it 
to  be.  Indeed,  without  this  “eraeking-open”  of  the  blaek  box,  direet  eomparison 
is  impossible,  but  there  are  spatial  and  speetral  smoothing  effeets  or  eorreetions 
partieular  to  eaeh  inversion  algorithm  that  eannot  be  aeeounted  for  in  this  manner. 
Seenarios  will  be  referred  to  by  the  seenario  numbers  in  the  first  eolumn  or  the 
seenario  deseriptions  in  the  seeond. 

5.3  Error  in  Modeling  Outputs 

The  atmospherie  eonstituent  errors  and  sensitivities  presented  earlier  eombine  to 
produee  propagated  errors  in  the  modeling  outputs:  ti,  T2,  Ld,  and  L„.  This  step 
provides  the  solution  to  equations  4.32  through  4.35.  Five  basie  seenarios  are  ear¬ 
ned  forth  from  here  on  out,  one  eorresponding  to  eaeh  of  the  sourees  deseribed 
in  the  preeeding  seetions.  From  this  point  on,  results  eannot  be  generated  without 
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Table  5.8:  Atmospheric  Uncertainty  Scenario  Settings 


Source 

Water  vapor 

Density  altitude 

Aerosols 

1 

Climatology 

1.06  cm 

0.2  km 

0.39 

2 

Instrumentation  -  field 

0.2  cm 

0.045  km 

0.04 

3 

Instrumentation  -  ARM 

0.03  cm 

0.017  km 

0.02 

4 

In-scene  -  wet/hazy 

0.3  cm 

0.040  km 

0.063 

5 

In-scene  -  dry/clear 

0.05  cm 

0.004  km 

0.053 

a  selection  of  input  error  drivers.  This  loss  of  generality  will  be  accommodated 
by  constructing  multiple  scenarios  using  the  source  error  magnitudes  described  in 
table  5.8. 

For  the  most  part,  error  in  each  modeling  output  is  not  individually  interest¬ 
ing.  To  be  intuitively  significant,  it  is  necessary  to  fully  propagate  this  error  into 
reflectance  space.  Sample  results  showing  the  error  in  modeling  outputs  for  sce¬ 
nario  1  are  presented  in  figure  5.11.  Results  for  all  scenarios  will  not  be  presented 
because  they  all  share  the  same  general  shape  but  differ  in  magnitude  and,  to  a 
slight  degree,  relative  magnitude.  For  each  of  the  basic  scenarios,  the  atmospheric 
constituent  uncertainties  tend  to  either  all  increase  or  decrease,  but  there  are  also 
differences  in  the  relative  uncertainty  between  instruments.  As  an  example,  the  im¬ 
provement  in  water  vapor  uncertainty  between  scenarios  2  and  3  is  drastic  because 
of  the  improvement  gained  by  moving  from  field  instruments  to  research  instru¬ 
ments.  By  comparison,  the  improvement  in  aerosol  optical  density  uncertainty, 
while  halved  between  scenarios,  is  still  not  quite  as  drastic.  This  shift  in  relative 
magnitudes  is  first  manifested  in  these  results  and  carried  throughout  all  scenarios. 


5.4  Sensor  Modeling  Results 

5.4.1  Radiometric  precision 

Sensor  modeling  was  accomplished  by  using  sensor  noise  cal  results  published  by 
others.  Several  representative  noise  models  are  presented  in  figure  5. 12.  First  flown 
in  1987,  AVIRIS  has  defined  the  standard  for  hyperspectral  imagery  for  years, 
leading  the  industry  not  only  in  instrument  design,  but  also  in  calibration,  process¬ 
ing  and  exploitation  (Vane,  1987).  Incremental  changes  to  the  system’s  configu¬ 
ration  has  resulted  in  improvements  to  calibration  accuracy  over  time,  with  max 


Error  In  taul 


126 


CHAPTER  5.  RESULTS  AND  DISCUSSION 


Error  propagated  into  taul  Error  propagated  inta  tau2 


(a)  Error  in  ri  (b)  Error  in  T2 

Error  propagated  into  Ld  Error  propagated  into  Lu 


(c)  Error  in  Ld  (d)  Error  in 

Figure  5.11:  Sample  results  for  error  in  modeling  outputs.  Results  are  shown  for 
basic  scenario  1 .  Each  graph  shows  the  error  propagated  into  each  radiative  transfer 
modeling  output  by  individual  constituent. 
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SNR  growing  from  about  50  to  over  1000  (Green  and  Pavri,  2000).  Of  the  curves 
that  are  available,  figures  5.12(a)  and  5.12(b)  show  selected  results  from  the  1997 
flight  season  (Green,  1997).  Selecting  an  older  performance  data  set  puts  the  noise 
model  more  in  line  with  what  other,  less  advanced  sensors  are  able  to  achieve.  The 
AVIRIS  noise  is  expressed  in  neAL. 

The  Hyperspectral  Digital  Imagery  Collection  Experiment  (HYDICE)  is  an 
imaging  spectrometer  operated  by  the  Department  of  Defense.  It  has  a  very  similar 
configuration  to  AVIRIS  but  poorer  noise  performance  (Mitchell,  1995).  Whereas 
AVIRIS’  SNR  can  range  from  300-1200,  HYDICE  peaks  at  approximately  200 
(Okin  et  al.,  2001),  although  like  AVIRIS,  the  baseline  performance  in  later  exper¬ 
iments  was  much  improved  (Nischan  et  al.,  1999).  HYDlCE’s  noise  performance 
was  reported  as  SNR,  but  the  illumination  conditions  were  also  reported:  6k  alti¬ 
tude,  60°  sun  zenith  angle,  and  5%  reflectance.  The  noise  in  radiance  units  was 
backed  out  by  estimating  the  input  spectrum  using  MODTRAN  and  reported  as 
such  in  figure  5.12(c). 

It  is  important  to  note  that  noise  performance  of  instruments  is  generally  depen¬ 
dent  on  the  signal  level  used.  Unless  an  instrument  is  dominated  by  fixed  sources 
of  noise  (a  sign  of  a  very  noisy  instrument),  then  the  noise  is  correlated  to  signal 
due  to  such  sources  as  photon  shot  noise  and  gain-correlated  noise.  In  the  example 
instruments  presented  here,  this  was  not  given  consideration.  The  goal  of  this  re¬ 
search  was  to  demonstrate  that  instrument  noise  can  be  propagated  into  reflectance 
space  and  compared  with  other  sources.  The  model  does  not  have  the  ability  to 
process  multiple  noise  curves,  indexed  to  Lsr),  for  a  given  instrument,  nor  can  it 
accept  a  functional  expression  of  noise.  Extension  of  the  model  to  two  dimensions 
would  probably  need  to  include  this  improvement  so  that  instrument  noise  can  be 
accurately  processed  over  a  scene  that  includes  both  bright  and  dark  pixels. 

The  pre-ship  lab  performance  of  the  Hyperion  instrument  flown  on  the  EO-1 
spacecraft  is  shown  in  figure  5.12(d)  (Browne,  1999).  It  was  also  reported  as  an 
SNR  curve,  but  again  the  input  spectrum  was  estimated  using  MODTRAN  for  the 
reported  illumination  conditions:  orbit  altitude,  60°  zenith,  and  a  30%  reflector.  It 
exhibits  a  similar  shape  to  the  HYDICE  curve  with  somewhat  noisier  performance 
across  the  spectrum.  In  fact,  Hyperion’s  noise  performance  was  so  different  that 
a  closer  look  was  warranted.  Eigure  5.13  shows  the  results  of  an  atmospheric 
inversion  study  presented  by  Goetz  et  al.  (2003).  It  is  claimed  that  the  high  noise 
seen  in  figure  5.12(d)  both  below  500  nm  and  above  2  microns  manifests  as  high 
error  in  retrieved  reflectance  (departure  from  the  nominal  50%  reflectance  line)  in 
figure  5.13. 

These  3  instruments  provide  a  range  of  options  for  instrument  noise  perfor- 
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mance  over  a  common  spectral  range  when  propagating  error  through  other  parts 
of  the  imaging  chain. 

5.4.2  Radiometric  accuracy 

In  addition  to  instrument  precision,  an  effort  was  made  to  account  for  unresolved 
radiometric  calibration  validation  discrepancies,  which  are  treated  as  a  bias.  Al¬ 
though  an  instrument  can  be  calibrated  in  the  laboratory  and  on  the  platform  before 
and  after  each  collection,  there  are  still  opportunities  for  calibration  errors.  Bias 
is  a  difficult  subject  to  treat  because  after  a  calibration,  it  is  assumed  to  not  exist. 
After  that,  though  one  may  suspect  it  exists,  it  cannot  be  detected  until  after  a  cal¬ 
ibration  validation.  After  this,  the  calibration  is  adjusted,  in  theory  eliminating  the 
bias  once  again  until  the  next  validation. 

As  will  be  seen  with  both  the  AVIRIS  and  Hyperion  studies  referenced  here, 
part  of  the  root  problem  is  error  in  the  calibration  reference,  though  other  error 
sources  exist.  These  error  sources  are  listed  in  Green  and  Pavri  (2003)  as  imperfect 
knowledge  of  the  calibration  standard,  drift  of  the  calibration  over  time,  and  errors 
in  the  validation  source  (MODTRAN). 

Calibration  validation  results  for  AVIRIS  from  2002  are  presented  in  figure 
5.14.  This  will  be  used  as  a  represenfafive  example  of  calibrafion  accuracy,  wifh 
general  agreemenf  fo  wifhin  5%  and  fhe  majority  of  fhe  bands  agreeing  fo  wifhin 
2%.  This  was  noted  fo  be  highly  accepfable. 

In  confrasl  wifh  AVIRIS,  2001  radiomefric  calibrafion  accuracy  resulfs  were 
reporfed  for  Hyperion  fo  exceed  10-20%,  depending  on  specfral  regime  (Green 
el  ah,  June  2003).  The  primary  driver  for  Ibis  discrepancy,  shown  in  figure  5.15, 
was  a  problem  wifh  fhe  original  laborafory  calibrafion  reference.  Following  Ibis 
discovery,  Hyperion’s  calibration  was  adjusled  fo  wifhin  3%  of  fhe  assumed  ref¬ 
erence  value:  an  11%  negafive  bias  in  fhe  VNIR  specfral  region  was  correcled  by 
8%,  and  a  21%  negative  bias  in  fhe  SWIR  specfral  region  was  corrected  by  18%. 
Bofh  fhe  AVIRIS  band-by-band  resulfs  and  a  slraighl  3%  negafive  bias  will  be  used 
as  error  model  inpufs. 

5.4.3  Spectral  calibration 

If  is  possible  fo  simulate  fhe  effecl  of  any  degree  of  bias  and  jifler  for  any  largel 
specfrum  for  any  afmosphere.  The  baseline  afmosphere  described  in  fables  4.1, 
4.2,  and  4.3  was  used  for  all  cases.  Allhough  differenl  afmospheres  and  viewing 
geomelry  would  change  fhe  aclual  curves,  fhe  absorplion  fealures  would  all  be  in 
fhe  same  places,  fhe  general  shapes  would  be  fhe  same,  and  fhe  afmosphere  would 
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Figure  5.12:  Instrument  radiometrie  ealibration  noise  models 
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Wavelength,  nm 


Figure  5.13:  Reflectance  retrieval  from  Hyperion  imagery.  Figure  taken  from 

Goetz  et  al.  (2003). 


continue  to  be  the  primary  contributor  to  the  radiance  error.  Therefore,  it  was 
determined  to  not  be  useful  to  show  the  variation  of  spectral  misregistration  errors 
over  a  range  of  atmospheres.  In  contrast,  a  moderate  degree  of  radiance  change  was 
observed  to  depend  on  the  target  spectrum  used,  and  the  highest  degree  of  change 
resulted  from  the  amount  of  spectral  shift. 

These  observations  are  supported  by  figure  5.16.  A  family  of  curves  is  shown 
in  each  plot,  where  the  two  black  curves  represent  a  100%  and  an  18%  reflector. 
The  100%  reflector  curve  creates  the  outer  envelope,  while  the  18%  radiance  curve 
shows  the  least  amount  of  change.  The  colored  curves  represent  the  same  7  ground 
cover  types  mentioned  earlier,  which  span  the  space  between  the  two  enveloping 
curves.  Between  700  and  800  nm,  the  red  edge  effect  causes  the  radiance  bias  for 
the  vegetation  targets  to  exceed  that  of  the  100%  reflector.  Together,  these  features 
demonstrate  that  absolute  reflectance  as  well  as  spectral  shape  determine  the  effect 
on  sensor  radiance. 

Figure  5.16(a)  shows  a  result  for  a  0.25  nm  shift  for  all  bands,  whereas  5.16(b) 
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(a)  Raw  data 


(b)  Percent  bias 


Figure  5.14:  Estimated  2002  AVIRIS  radiometric  calibration  bias  model.  Figure 
5. 14(a)  comes  from  Green  and  Pavri  (2003). 
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Wavelength  (nm) 


Figure  5.15:  Observed  2001  Hyperion  radiometrie  ealibration  bias.  Figure  is  taken 

from  Green  et  al.  (June  2003). 


shows  the  effeet  of  a  0.5  nm  shift.  Whereas  the  various  target  types  show  small 
variation  within  the  envelope  ereated  by  the  bright  and  dark  gray  refleetors,  the 
degree  of  shift  has  a  very  strong  maero-level  effeet.  The  0.5  nm  shift  nearly  doubles 
the  effeet  on  sensor-reaehing  radianee  for  some  bands.  For  affeeted  bands,  the 
effeet  tends  to  inerease  with  inereased  shift.  A  band  eenter  shift  in  the  negative 
direetion  produees  nearly  identieal  results,  exeept  the  signs  are  reversed. 

This  information  is  presented  another  way  in  figure  5.17,  whieh  shows  the 
standard  deviation  of  all  ground  target  types  with  respeet  to  the  pereent  error  in 
radianee.  In  other  words,  the  sensor-reaehing  radianees  for  all  7  target  speetra 
and  3  gray  refleetors  (100%,  50%,  and  18%)  were  reeonvolved  with  the  shifted 
band  model,  and  the  standard  deviation  of  the  10  results  was  taken  as  a  funetion 
of  wavelength  and  degree  of  shift.  Any  ehanges  in  radianee  due  to  atmospherie 
features  will  be  eommon  to  all  of  the  speetra,  so  variation  in  the  results  should  be 
a  result  of  the  unique  eontributions  of  eaeh  speetrum  relative  to  the  others.  This 
ean  be  verified  by  inspeetion  of  figures  4.13  and  5.17.  Those  points  in  figure  4.13 
where  the  slope  is  highest  eorrespond  to  the  points  of  highest  variation  in  figure 
5.17.  They  do  happen  to  fall  within  atmospherie  absorption  bands,  but  this  most 
likely  the  result  of  sensor  artifaets  from  when  the  speetra  were  originally  measured. 
Beeause  of  the  redueed  importanee  plaeed  on  the  atmospherie  absorption  bands 
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(a)  0.25  nm  band  center  shift 


(b)  0.5  nm  band  center  shift 

Figure  5.16:  Radiance  bias  error  due  to  spectral  misregistration.  The  black  curves 
bounding  the  family  represent  results  for  a  100%  and  an  18%  reflector.  The  colored 
curves  correspond  to  results  for  each  of  the  7  target  types  shown  in  figure  4.13. 
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(especially  the  1390  and  1900  nm  regions),  it  can  be  argued  that  choice  of  target 
reflectance  spectrum  skewed  the  results,  depressing  the  significance  of  spectral 
character  on  spectral  misregistration-induced  radiance  shifts.  But,  it  must  be  noted 
that  because  the  most  typical  types  of  ground  cover  were  chosen,  it  is  acceptable 
to  conclude  dominance  of  atmospheric  absorption  features  is  a  natural  state. 


500  1000  1500  2000  2500 

Wavelength  (nm) 


Figure  5.17:  Standard  deviation  in  percent  radiance  error  due  to  the  variability  of 

target  spectra 


The  modeling  of  spectral  jitter  effects  was  accomplished  by  generating  a  nor¬ 
mal  probability  density  function  centered  on  the  band’s  nominal  central  wavelegth 
with  the  standard  deviation  set  to  0.5  nm.  Radiance  curves  were  generated  by 
shifting  the  Gaussian  response  curve  center  over  ±4  standard  deviations,  subtract¬ 
ing  the  mean  from  each  result,  squaring  it,  multiplying  by  the  probability  density 
function,  and  finally  summing  it.  This  process,  shown  in  equation  5.3,  approxi¬ 
mates  the  second  central  moment  or  variance,  of  a  function  given  its  probability 
density  function.  The  width  of  the  probability  density  function  was  chosen  to  cor¬ 
respond  to  observed  jitter  for  HYDICE  according  to  Nischan  et  al.  (1999),  albeit 
on  the  high  end  of  the  reported  range.  The  jitter  was  recorded  as  fractions  of  a 
channel  corresponding  to  approximately  0.3-0.6  nm,  but  it  could  be  as  bad  as  4.5 
nm,  depending  on  spectral  band.  An  offset  of  approximately  0.15  nm  was  also 
reported. 
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Figure  5.18  shows  the  resulting  uneertainty  eurves  for  the  two  bounding  spee- 
trally  flat  eases-the  100%  and  18%  refleetors-as  well  as  for  the  7  ground  eover 
targets.  The  100%  reflee  tor  produees  an  upper  bound  on  the  uneertainty,  showing 
that  target  brightness  is  again  a  signifieant  eontributing  faetor.  Even  though  the 
target  is  speetrally  flat,  the  atmosphere  imparts  the  speetral  shape  driving  the  un¬ 
eertainty,  and  brighter  targets  have  deeper  absorption  features,  stronger  slopes,  and 
ultimately  a  greater  sensitivity  to  speetral  misregistration  effeets.  Contributions 
from  the  shape  of  the  refleetanee  speetra  are  again  seen  in  the  visible  region,  where 
some  of  the  ground  eover  eurves  exeeed  the  envelope  limits  of  the  flat  refleetors.  In 
these  speetral  regions,  the  ground  eover  eurves  have  slopes  strong  enough  to  show 
up  in  the  radianee  uneertainty  results.  Overall,  it  is  noteworthy  that  speetral  jitter, 
seen  in  figure  5.18,  is  of  the  same  order  of  magnitude  as  radiometrie  ealibration 
uneertainty,  as  seen  in  figure  5.12. 

Beeause  ehange  in  radianee  due  to  speetral  ealibration  errors  is  highly  sensitive 
to  multiple  faetors,  it  is  diffieult  to  abstraet  the  behavior  into  a  generalized  model. 
Any  model  used  is  dependent  on  amount  of  bias  or  jitter,  the  target  brightness, 
and  the  speetral  shape,  and  while  general  behaviors  ean  be  deseribed  based  on 
the  first  two  faetors  alone,  the  “wildeard”  nature  of  the  target  refleetanee  speetrum 
reduees  the  utility  of  attempting  to  prediet  error  performanee.  This  situation  is 
similar  to  the  problem  presented  by  modeling  elouds  and  baekgrounds,  but  not  as 
nieely  behaved.  Results  will  be  presented  that  show  the  radianee  errors  presented 
so  far  propagated  into  refleetanee  spaee.  Two  seenarios  were  erafted  to  treat  the 
effeet  of  speetral  misregistration  on  retrieved  refleetanee,  one  for  bias  and  one  for 
jitter,  based  on  a  notional  ease  erafted  for  investigative  purposes.  However,  as  with 
baekground  objeets,  the  top  level  error  propagation  model  provides  no  interfaee  to 
model  speeifie  target  speetra.  A  two-dimensional  predietive  tool  able  to  operate  on 
aetual  imagery  eould  provide  this  eapability,  but  that  task  is  left  to  future  work. 


5.5  Environmental  error  modeling  results 

Although  the  naming  may  seem  unintuitive,  reeall  that  “environmental  errors”  refer 
not  to  elements  of  the  atmosphere,  but  instead  to  elements  of  the  remote  sensing 
environment.  They  were  segregated  from  atmospherie  uneertainty  for  two  reasons: 
they  are  unpredietable  aeeording  to  any  equation  or  funetional  relationship,  and 
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Figure  5.18:  Uncertainty  in  radiance  due  to  0.5  nm  spectral  jitter 


their  error  is  unbounded.  Despite  these  considerations,  it  is  necessary  to  illustrate 
the  effects  on  retrieved  reflectance  error. 

It  was  unnecessary  to  build  a  model  for  ground  tilt  angle  because  it  appears 
directly  in  the  final  reflectance  expression,  and  there  is  no  connection  to  antecedent 
sources.  The  models  for  instrument  pointing  angle,  clouds,  and  background  objects 
permit  specification  of  the  effect,  and  they  will  propagate  their  contribution  forward 
into  reflectance  space.  Results  are  presented  that  show  their  effects  on  the  modeling 
outputs  Ld,  Lu,  and  T2. 

5.5.1  Pointing  angle  modeling  results 

Off-nadir  pointing  produces  bias  error  in  Lu  and  T2.  The  fourth-order  equation  fit 
technique  was  used  to  produce  analytical  relationships  for  Lu  and  T2  as  a  function 
of  pointing  angle  ij:  and  wavelength.  Representative  examples  of  these  are  shown 
in  equations  5.4,  which  is  for  upwelled  radiance  at  550  nm  for  a  platform  at  792  m, 
and  5.5,  which  is  for  transmissivity  at  the  same  point.  It  would  be  impractical  to 
list  all  equation  fit  coefficients  for  all  altitudes.  Although  it  may  seem  odd  to  keep 
the  higher  order  terms,  it  must  be  noted  that  the  input  units  for  ij:  is  in  degrees,  and 
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the  values  for  downwelled  radianee  are  on  the  order  of  10“^  to  10“^.  When  the 
input  variable  is  put  to  the  third  or  fourth  power,  multiplying  it  by  sueh  a  small 
eoeffieient  still  produees  output  just  large  enough  to  affeet  the  final  result,  so  5 
eoeffieients  were  earried  for  this  fit  teehnique.  There  would  be  negligible  eompu- 
tational  penalty  for  earrying  even  higher  order  terms,  but  this  was  felt  to  be  a  good 
eut-off  point. 


550)  =  4.01  X  10“°^  -  7.98  x  10“°^  +  6.29  x  10“°V^ 

-  2.26  X  10“^ +  3.15  X  lO-^V^  (5-4) 


r2(V';550)  =  -1.85  +  5.70  x  lO-^^V' -  4.51  x  10“°V 

+  1.63  X  lO-^V'^  -  2.26  X  10“®V’'‘  (5-5) 

Propagated  error  in  and  T2  as  a  result  of  off-nadir  sensor  pointing  is  pre¬ 
sented  for  the  various  available  altitudes  starting  with  792  m  in  figure  C.l,  4  km 
in  figure  C.l,  11  km  in  figure  C.3,  and  finishing  with  100  km  in  figure  C.4.  Both 
absolute  and  results  relative  to  nadir  are  shown.  There  is  a  general  trend  that  as  the 
absolute  value  of  the  modeling  output  deereases,  the  effeet  of  off-nadir  pointing 
inereases.  Thus,  as  upwelled  radianee  inereases  with  altitude,  the  pereent  ehange 
at  45°  pointing  angle  deereases  from  about  40%  to  30%.  However,  below  25° 
from  nadir,  there  is  a  mueh  smaller  ehange  (<10%)  that  is  relatively  insensitive  to 
altitude. 

Transmissivity  shows  similar  behavior.  As  the  absolute  value  deereases  with 
inereasing  altitude,  the  pereent  differenee  with  inereasing  ip  inereases  quite  a  bit, 
from  -5%  to  -23%.  The  insensitivity  range  only  applies  within  ±5  °  of  nadir. 

A  final  set  of  results  is  presented  in  figure  C.5,  whieh  eompares  multiple  seat- 
tering  algorithms.  There  is  the  barest  hint  of  a  differenee  at  45°  off-nadir  in  the 
lowest  wavelengths,  an  effeet  that  just  exeeeds  1%  of  upwelled  radianee.  It  may 
seem  so  small  as  to  be  insigniheant,  but  as  this  work  tries  to  expose  effeets  oper¬ 
ating  in  the  sub-  to  few-pereent  regime,  it  was  eonsidered  worthwhile  to  avoid  an 
unneeessary  1  %  hit  to  upwelled  radianee. 

These  modeling  results  for  the  off-nadir  pointing  effeet  show  a  great  deal  of 
sensitivity  of  the  parameter  to  off-nadir  poitning,  but  the  effeet  in  refleetanee  spaee 
is  unknown  at  this  time.  The  implieation  of  this  variability  is  not  obvious  with¬ 
out  earrying  the  propagation  all  the  way  forward  into  refleetanee  spaee.  While  a 
30%  inerease  in  upwelled  radianee  or  15%  deerease  in  transmissivity  from  nadir 
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to  ±20°  off-nadir  may  seem  severe,  the  ehange  in  one  parameter  does  not  guaran¬ 
tee  a  signifieant  addition  of  bias  error  or  random  uneertainty  to  the  final  retrieved 
refleetanee. 

5.5.2  Cloud  modeling  results 

Cloud  eover  eauses  bias  error  in  Ld-  The  produet  of  the  eloud  model  proeess  is 
shown  in  figure  5.19.  The  Monte-Carlo  style  simulation  produeed  24,000  speetra, 
eaeh  of  whieh  eorresponded  to  a  eertain  number  of  sky  quads  filled  wifh  eloud 
and  a  eerfain  pereenfage  of  fhe  sky  dome  obseured  by  eloud.  Beeause  if  was  nol 
reasonable  fo  sfudy  every  possible  sky  quad  eonfigurafion,  fhe  sampling  in  figure 
5.19  affempfs  fo  adequafely  span  fhe  eonfigurafion  spaee. 

Eaeh  speefrum  was  produeed  by  speeifying  fhe  independenf  variable,  number 
of  quads,  buf  fhey  musf  be  re-indexed  fo  sky  fraelion  beeause  fhe  model  speeifies 
elouds  aeeording  fo  sky  fraelion.  As  an  example,  all  poinls  eorresponding  fo  20 
eloud  quads  are  boxed  in  figure  5.19(a).  Allhough  fhe  quads  are  equiangular,  fhey 
have  differenl  areas,  so  differenl  eombinalions  of  a  given  number  of  quads  will 
have  differenl  eombined  areas,  whieh  aeeounfs  for  fhe  verlieal  spread  in  fhe  box  in 
figure  5.19(a). 

The  speelra  were  Ihen  regrouped  by  sky  fraelion,  whieh  is  shown  by  example 
in  figure  5. 19(b).  In  fhe  example,  all  speelra  eovering  25-30%  of  Ihe  sky  are  boxed. 
The  resulls  lo  follow  are  aggregated  in  5%  bins,  bul  in  Ihe  model,  any  euslom  range 
speeifiealion  ean  be  applied  lo  Ihe  enlire  dalasel  and  Ihese  resulls  are  regenerated 
on-lhe-fiy. 

Figure  C.6  shows  Ihe  effeel  of  Ihe  eloud  simulalion  on  downwelled  radianee. 
The  radianee  eurves  in  figure  C.6(a)  are  grouped  by  quad,  and  Ihose  in  figure  C.6(b) 
are  grouped  by  sky  fraelion.  Eaeh  grouping  was  eompared  againsl  Ihe  elear  sky 
downwelled  radianee  and  had  ils  rool-mean-square  devialion  ealeulaled.  These 
eurves  are  ealeulaled  for  presenlalion  purposes  only.  In  praeliee,  Ihe  model  earries 
all  speelra  forward  in  raw  form  and  individually  ealeulales  Iheir  effeels  on  Ihe  final 
result  Also,  note  lhal  beeause  Ihe  rool  mean  square  is  shown,  all  resulls  are  pre¬ 
sented  as  posilive.  However,  aelual  bias  errors  are  posilive  or  negalive  depending 
on  eondilions,  and  all  ealeulalions  earry  Ihe  eorreel  sign  Ihroughoul. 

Finally,  several  lypes  of  elouds  were  tested.  Figure  C.7  shows  relalive  effeel  on 
downwelled  radianee  for  slralus  and  alloslralus  elouds.  There  are  minor  differenees 
on  Ihe  order  of  single-digil  pereenlages  in  Ihe  mosl  affeeled  wavelenglhs.  High 
allilude  eirrus  elouds,  bolh  visible  and  invisible,  would  be  a  weleome  addilion  lo 
Ihe  eloud  simulalion  model.  Wylie  and  Menzel  (1989)  eslimale  lhal  nol  only  is 
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Figure  5.19:  Relationships  between  cloud  quads  and  sky  fraction 
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45%  of  the  United  States  is  eovered  by  opaque  elouds  at  any  time,  but  also  that  an 
additional  20-30%  is  eovered  by  thin,  semi-transparent  eirrus  elouds. 

Clouds  are  eritieal  eontributors  to  the  remote  sensing  environment.  These  re¬ 
sults  merely  give  a  hint  as  to  the  potential  variability  elouds  provide,  and  further 
researeh  is  required  into  the  validity  of  the  eurrent  modeling  teehnique  with  dif¬ 
ferent  eloud  types  and  geometries,  espeeially  partially  transparent  elouds.  For  a 
remote  sensing  user  attempting  to  estimate  eloud  eover,  it  is  elear  that  not  only 
does  eloud  eover  have  the  potential  to  greatly  influenee  one  or  more  remote  sens¬ 
ing  parameters,  but  that  “perfeet  estimation”  is  a  mutli-dimensional  problem.  Even 
if  the  amount  of  eloud  eover  were  perfeetly  known,  these  results  show  that  geome¬ 
try  eauses  great  variability  in  the  effeets  on  the  downwelled  radianee.  If  both  eloud 
amount  and  loeation  were  both  known,  then  eloud  type  and  opaeity  beeome  impor¬ 
tant  variables.  If  all  eloud  parameters  are  perfeetly  known,  the  time-varying  nature 
of  eloud  eover  very  quiekly  invalidates  the  estimate.  If  elouds  eannot  be  modeled, 
and  they  eannot  be  avoided,  the  only  remaining  eourse  of  aetion  of  a  user  is  to 
look  for  remote  sensing  regimes  for  whieh  the  impaet  of  eloud  eover  is  minimized. 
Presented  later  are  results  where  these  error  speetra  are  propagated  into  refleetanee 
spaee  will  provide  pointers  to  eonelusions  of  this  nature. 

5.5.3  Background  object  modeling  results 

Sky  obscuration  by  background  objects  also  causes  variability  in  L^.  However, 
because  the  simulation  was  restricted  to  the  lowest-elevation  ring  of  quads,  the  12 
quads  subject  to  background  obscuration  are  equal  in  size.  As  a  result,  figure  5.20 
shows  much  less  diversity  in  sky  fraction  that  did  figure  5.19.  The  implicafions 
of  Ibis  resulf  are  shown  in  fhe  figure.  The  verfical  blue  box  encloses  all  oufpuf 
specfra  corresponding  fo  6  of  fhe  12  quads  being  filled  wifh  background  objecfs, 
identically  fo  fhe  cloud  simulation.  However,  because  fhere  is  no  area  diversify  in 
fhe  acfivafed  quads,  fhere  are  fracfions  wifh  zero  corresponding  radiance  specfra. 
Alfhough  fhis  would  only  happen  for  cerfain  cases  wifh  narrow  sky  fracfion  ranges, 
if  is  possible.  An  example  is  shown  wifh  fhe  magenfa  box  in  figure  5.20,  which 
affempfs  fo  enclose  specfra  covering  20%  ±1%.  No  background  radiance  specfra 
meef  fhe  hypofhefical  specification,  so  fhe  range  would  need  fo  be  widened  for 
fhe  model  fo  funclion  properly.  The  red  box  encloses  fhe  specfra  fhaf  would  be 
refrieved  by  a  specification  of  10%  ±  1%,  jusf  as  wifh  fhe  cloud  simulation. 

Figure  C.8  shows  fhe  effecl  of  background  objecfs  on  downwelled  radiance. 
Because  fhe  clear  sky  quad  was  replaced  wifh  a  composite  ground  objecf  specfrum, 
fhe  change  in  downwelled  radiance  is  quife  differenlly  shaped  from  fhe  cloud  spec- 
fra.  However,  fhe  magnifude  of  Ibis  change,  as  shown  in  figure  C.8(d),  is  af  leasf  an 
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Sky  Fraction  by  Number  of  Background  Quads 


Figure  5.20:  Correlation  between  background  quads  and  sky  fraction 


order  of  magnitude  lower  than  the  effects  of  clouds  and  thus  of  much  lower  con¬ 
cern.  Again,  the  root  mean  square  curves  are  all  are  positive,  but  actual  bias  errors 
are  positive  or  negative  depending  on  conditions. 

5.5.4  Environmental  error  scenario  summary 

The  environmental  effect  modeling  presented  in  the  preceding  sections  was  ap¬ 
plied  to  propagate  bias  and  random  uncertainty  into  the  final  reflectance  retrieval. 
Baseline  values  and  uncertainty  ranges  were  selected  for  each  and  propagated  into 
reflectance  space.  For  each  scenario  listed  in  table  5.9,  results  will  be  presented 
that  show  the  effect  on  reflectance  error  and  that  compare  the  relative  magnitude  of 
these  contributions  to  those  induced  by  atmospheric  uncertainty.  Note  the  scenario 
numbering  continues  from  table  5.8. 

5.5.5  Combined  effects 

Although  not  strictly  an  environmental  condition,  one  final  scenario  was  creafed. 
It  combines  the  random  contributions  from  basic  scenario  2  with  reasonable  envi- 
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Table  5.9:  Environmental  Error  Seenario  Settings 


Environmental  Effeet 

Seenario  baseline 

Uneertainty  range 

6 

Nadir  angle  bias 

792  m 

0-15° 

7 

Nadir  angle  bias 

4  km 

0-15° 

8 

Nadir  angle  bias 

100  km 

0-15° 

9 

Nadir  angle  uneertainty 

4  km,  0°  nadir 

0-1° 

10 

Nadir  angle  uneertainty 

4  km,  15°  nadir 

0-1° 

11 

Ground  tilt  bias 

0° 

0-15° 

12 

Ground  tilt  uneertainty 

5°  tilt 

0-10° 

13 

Ground  tilt  uneertainty 

20°  tilt 

0-10° 

14 

Cloud  eover  knowledge 

10%  eumulus  eover 

1-5% 

15 

Cloud  eover  knowledge 

20%  eumulus  eover 

1-5% 

16 

Baekground  objeets 

10%  obseuration 

1-5% 

17 

Baekground  objeets 

20%  obseuration 

1-5% 

18 

Sensor  random  noise 

none 

AVIRIS,  HYDICE,  Hyperion 

19 

Sensor  ealibration  bias 

none 

AVIRIS  (2002),  Hyperion  (-3%) 

20 

Speetral  bias 

0.25  and  0.5  nm  bias 

by  target  type 

21 

Speetral  jitter 

0.5  nm  uneertainty 

by  target  type 

ronmental  eontributions  taken  from  the  environmental  seenarios.  The  results  are 
a  synthesis  of  atmospherie  eonstituent  uneertainty,  environmental  bias  effeets,  en¬ 
vironmental  random  effeets,  sensor  bias,  and  sensor  random  effeets.  Thus,  this 
final  seenario  attempts  to  simulate  the  most  likely  best-ease  result  if  a  field  sen¬ 
sor  nefwork  were  used  fo  feed  a  model-only  inversion.  Table  5.10  summarizes  fhe 
paramefers  used. 


5.6  Total  error 

Seenario  error  propagafion  resulfs  reside  in  Appendiees  D  and  E.  All  seenarios 
were  run  using  bofh  a  100%  refleefor  and  a  20%  refieelor.  Seenarios  are  grouped 
info  fhree  eafegories.  “Basie”  seenarios  simulafe  only  eonfribufions  from  errors  in 
afmospherie  eonsfifuenf  determination.  “Environmental”  seenarios  simulate  a  wide 
variety  of  environmental  effeets  eontributing  bias  or  uneertainty,  one  seenario  per 
effeet.  These  effeets  inelude  ground  tilt,  sensor  pointing,  elouds,  baekground  oh- 
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Table  5.10:  Combined  Effeet  Seenario  Settings 


Parameler 

Value 

22 

Wafer  vapor  uncerlainly 

0.2  cm 

Densily  all.  uncerlainly 

0.045  km 

Aerosol  uncerlainly 

0.04 

Sensor  random  noise 

AVIRIS  (1999  posl-season  cal) 

Sensor  calibration  bias 

AVIRIS  (2002) 

Nadir  angle 

0° 

Nadir  angle  uncerlainly 

1  milliradian 

Ground  till 

0° 

Ground  till  uncerlainly 

5° 

Cloud  cover 

15%  cumulus  cover 

Cloud  cover  knowledge 

to  wilhin  ±5% 

Background  objecls 

5%  obscuration 

Speclral  bias 

0  nm 

Speclral  jiller 

0  nm 

jeets,  and  instrument  noise.  The  “eombined”  seenario  is  the  final  eategory,  in  whieh 
error  from  all  sourees  are  eombined  at  realistie  magnitudes  into  a  single  seenario. 
Each  scenario  from  the  first  two  categories  attempts  to  examine  a  single  source  at 
a  time  so  that  the  relative  influence  can  be  sfudied.  Error  confribufions  do  nol  sum 
linearly,  so  if  is  necessary  fo  sfudy  each  effecl  in  isolation.  The  final  scenario  shows 
fhe  effecl  of  combining  effecls.  Because  of  Ihe  endless  permulalions  possible  when 
combining  effecls,  fhe  magnifudes  were  sel  lo  Iheir  mosl  likely,  mosl  reasonable, 
or  mosl  useful  values. 

The  basic  scenarios  lisled  in  fable  5.8  produced  fhe  modeling  resulls  shown 
in  figures  D.3  fhrough  D.12.  The  resulls  show  lolal  refiecfance  error  prediclions 
along  wilh  error  confribufions  from  each  individual  oulpul.  The  correlated  error 
confribufions  are  also  shown  by  individual  componenl  on  separale  plols.  Summary 
resulls  are  presented  here  as  figure  5.21.  Uncerlainly  in  relrieved  refleclance  is 
shown  for  100%  and  20%  reflectors,  wilh  all  5  scenarios  plolled  logelher.  The 
black  curve  corresponds  to  fhe  fir  si  scenario,  which  uses  climalology-only  sources 
for  almospheric  consfiluenls.  The  red  and  green  curves  correspond  lo  ground  in- 
slrumenfs  of  low  and  high  qualify,  respeclively.  The  blue  and  cyan  curves  show 
fhe  predicled  approximale  uncerlainly  presenl  in  model-based  algorilhms  such  as 
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FLAASH.  The  two  curves  attempt  to  bound  the  performance  between  worst  case 
(humid  and  hazy)  and  best  case  (dry  and  clear)  atmospheric  conditions.  Each  sce¬ 
nario  will  be  presented  and  discussed  individually. 

The  environmental  effect  scenarios  listed  in  table  5.9  produced  the  results 
shown  in  figures  E.  1  through  E.  1 1 .  These  show  the  outcome  of  parametric  studies 
focusing  on  the  error  contributions  of  various  degrees  of  injected  environmental 
effects.  Because  single  effects  are  shown,  the  single  factor  contributions  always 
match  the  total  output,  therefore  only  total  random  error  or  total  bias  error  is  shown 
at  any  one  time.  These  results  are  so  diverse  and  unique  to  the  physical  factor  being 
simulated  that  summation  is  not  possible. 

It  is  extremely  important  to  remember  that  random  error  results  are  intended  to 
indicate,  by  spectral  band,  the  width  of  a  random  statistical  distribution  from  which 
random  errors  are  taken,  but  bias  errors  represent  a  literal  increase  or  decrease  in 
the  retrieved  reflectance. 

The  remainder  of  this  section  is  a  detailed  discussion  of  each  of  the  22  scenar¬ 
ios,  presented  either  individually  or  grouped  by  effect,  as  appropriate. 

5.6.1  Scenario  1  -  Climatological  sources 

Appendix  D,  starting  on  page  217,  contains  the  detailed  results  for  the  5  basic  sce¬ 
narios.  Scenario  1  reflects  the  use  of  a  priori  climatology  data  without  support 
from  in-scene  estimation  or  ground  truth  measurements.  This  starting  point  does 
not  serve  a  practical  purpose,  but  it  shows  the  effects  on  a  much  larger  scale  and 
may  serve  as  a  rough  measure  of  the  validity  of  using  default  inputs  in  scene  mod¬ 
eling.  The  predicted  standard  deviation  of  random  uncertainty  error  ranges  from 
0. 1-0.7  reflectance  units  for  a  100%  gray  reflector  (figure  D.3(a))  and  5-30  re¬ 
flectance  units  for  a  20%  gray  reflector  (figure  D.3(b)).  Eor  the  lower  reflectance 
target,  this  uncertainty  exceeds  the  actual  target  reflectance. 

Some  noteworthy  effects  that  will  run  across  scenarios  are  best  visible  in  the 
results  for  this  scenario.  An  intuitively  obvious  difference  between  the  contributing 
effects  for  100%  and  20%  reflectors  is  easily  shown  here.  Eor  the  100%  reflector, 
error  in  both  transmissivity  terms  dominates,  but  for  the  20%  reflector  the  upwelled 
radiance  dominates  as  it  is  unaffected  by  the  change  in  reflectance,  and  the  other 
terms  are  reduced  by  a  factor  of  5. 

The  other  interesting  effect  is  the  contribution  of  correlation  terms.  There  are 
six  correlation  terms  described  in  appendix  A,  and  the  sum  total  of  these  terms  is 
shown  in  figures  D.3(a)  and  D.3(b). 

The  actual  correlation  curve  shown  is  more  accurately  described  as  a  ’’signed 
square  root”  in  that  the  sign  of  each  term  is  recorded,  the  square  root  of  the  absolute 
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Error  in  overall  reflectance  by  input 
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Figure  5.21:  Total  reflectance  uncertainty  summary  for  basic  scenarios  1-5.  Color 
coding  shows  total  reflectance  error  for  basic  scenarios  1-5  in  the  following  order: 
black  (1),  red  (2),  green  (3),  blue  (4),  and  cyan  (5). 


value  is  taken,  then  the  sign  is  applied  to  the  result.  Unlike  the  other  terms,  the  sign 
of  the  correlation  terms  is  key,  so  it  is  preserved  before  the  square  root  is  taken. 
Because  correlation  terms  are  added  directly  without  squaring,  their  sign  is  critical 
to  understanding  the  results.  The  other  uncertainty  terms  contribute  to  final  error 
as  squared  error,  so  their  sign  is  not  important.  However,  the  other  error  terms  are 
all  combined  when  squared  but  presented  as  square  roots  of  the  squared  error  to 
provide  intuitive  context  for  the  magnitude  of  the  results.  The  correlations  are  not 
technically  squares  of  any  term,  but  they  also  need  to  be  shown  as  a  square  root  so 
that  the  relative  magnitude  of  their  contributions  is  placed  in  proper  context. 

There  is  a  high  negative  error  contribution  from  cross-correlation,  confirming 
the  common  knowledge  that  there  is  high  positive  correlation  between  the  two  radi¬ 
ance  modeling  outputs  and  the  two  transmissivity  modeling  outputs  and  high  nega¬ 
tive  correlation  between  each  radiance/transmissivity  combination.  These  positive 
and  negative  correlations  have  a  net  effect  of  reducing  the  total  uncertainty. 

The  underlying  component  correlation  terms  are  presented  later  in  the  same 
appendices,  as  figures  D.4(a)  and  D.4(b).  For  all  scenarios,  it  can  be  seen  that 
that  the  ti/t2  and  L^ILu  correlation  terms  are  positive  and  the  others  are  generally 
negative  (except  for  a  quirk  in  water  vapor  and  aerosol  behavior  at  the  low  end  of 
the  visible  spectrum,  explained  for  the  next  scenario). 
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Because  of  the  near-overhead  sensing  geometry,  the  correlation  between  the 
two  transmissivity  terms  is  directly  dependent  on  target  reflectance.  The  correla¬ 
tion  between  the  two  radiance  terms  has  a  smaller  dependence  on  reflectance.  In 
contrast,  the  negative  cross-correlations  between  transmissivity  and  scattered  radi¬ 
ance  consistently  match  each  other  across  the  range  of  scenarios  and  reflectances. 

The  noteworthy  observation  regarding  correlation  effects  is  seen  in  figure  D.3(b), 
where  the  upwelled  radiance  contribution  actually  exceeds  the  total  predicted  re¬ 
flectance  error.  The  correlation  term  reduces  the  overall  error  below  the  upwelled 
contribution  for  low  reflectance  targets,  an  effect  that  repeats  in  other  scenarios. 

5.6.2  Scenario  2  -  Field-quality  ground  instruments 

Scenario  2  predicts  the  retrieved  reflectance  uncertainty  from  a  “commercial-quality” 
sensor  network,  which  is  to  say  ground  truth  measurements  are  fed  into  MOD- 
TRAN  to  accomplish  model-only  inversion.  This  is  the  “poor  man’s”  inversion 
method,  used  by  someone  who  cannot  afford  either  science-quality  instruments  or 
a  hyperspectral  sensor  but  still  needs  surface  reflectance.  “Poor  man”  is  definitely 
a  misnomer  though,  as  any  organization  that  is  trying  to  extend  the  use  of  existing 
platforms  that  lack  sounding  capabilities,  needs  to  make  use  of  ad-hoc  ground  truth 
networks,  and  is  interested  in  reflectance  inversion  is  subject  to  the  constraints  of 
this  type  of  scenario  regardless  of  resources. 

“Commercial  quality”  instruments  describes  the  smaller,  lower-accuracy  com¬ 
mercially  available  instruments  that  can  be  field-deployed  in  an  unattended  net¬ 
work.  “Field  quality”  is  another  way  of  describing  this  type  of  network.  In  truth, 
instruments  placed  into  this  category  are  not  low  quality,  rather  they  are  the  state 
of  the  art. 

As  seen  in  figure  D.5(a),  the  error  propagation  model  predicts  4—10  reflectance 
units  of  uncertainty  in  the  visible  spectrum  for  a  100%  reflector.  Figure  D.5(b) 
shows  a  prediction  of  1-5  reflectance  units  of  uncertainty  in  the  visible  range  for  a 
20%  reflector.  Again,  with  the  lower  reflectance  target  error  in  upwelled  radiance 
dominates  the  result  with  a  shape  that  suggests  aerosol  contributions  (this  is  studied 
in  more  detail  in  later  results). 

The  other  main  feature  to  observe  here  is  the  sign  inversion  in  the  correlation 
term.  A  comparison  of  figures  D.6(a)  and  D.6(b)  shows  that  the  downwelled  ra¬ 
diance  correlation  terms  exert  increased  influence  for  the  100%  reflector  and  that 
they  are  responsible  for  the  sign  inversion  below  550  nm.  From  experience  this  is 
known  to  be  a  joint  aerosol/water  vapor  effect.  The  aerosol  model  used  is  known 
to  drop  off  in  scattering  below  500  nm.  Also,  it  is  concluded  here  that  water  va¬ 
por’s  absorption  effects  give  way  to  density  effects  in  the  lower  end  of  the  visible 
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spectrum.  Water  vapor  is  significantly  less  dense  than  dry  air,  and  this  decrease  in 
density  is  in  constant  tension  with  water  vapor’s  tremendous  absorption  capabil¬ 
ity,  though  density  ultimately  loses  this  fight  for  dominance.  However,  the  density 
effects  are  visible  far  enough  away  from  those  absorption  bands.  The  main  conclu¬ 
sion  from  this  observation  is  that  lower  target  reflectances  exhibit  more  nonlinear 
error  behavior  than  higher  reflectances.  This  conclusion  is  validated  by  the  valida¬ 
tion  results  for  this  scenario,  shown  in  figures  F.3  and  F.4. 

5.6.3  Scenario  3  -  Research  quality  ground  instruments 

Scenario  3  employs  fhe  besf  ground  sensor  nefwork  available  fo  drive  fhe  model- 
only  inversion  mefhod.  These  sensor  capabilities  are  infended  fo  mafch  fhe  De- 
parfmenf  of  Energy’s  ARM  program,  fhough  fhe  program  is  much  more  exfensive 
fhan  fhe  sensor  survey  resulfs  in  secfion  5.2.2.  Their  abilify  fo  fiber  mulfiple  ob- 
servafions  from  mulfiple  insfrumenfs  during  infensive  observation  periods  is  nol 
reflecfed  here. 

Figures  D.7(a)  and  D.7(b)  show  error  model  predictions  for  fhe  100%  and  20% 
refleclors,  respecfively.  There  are  some  minor  differences  fhaf  conlrasf  wifh  sce¬ 
nario  2,  namely  an  increased  confribufion  from  fhe  correlated  error  ferms,  a  greafly 
increased  relative  confribufion  from  upwelled  radiance  for  fhe  low  refleclance  far- 
gef,  and  a  change  in  dominance  for  fhe  high  refleclance  largel.  This  change  in 
dominance  is  more  of  a  shifl  from  upwelled  dominance  fo  co-dominance  for  all 
fhe  ferms,  and  if  is  seen  by  fhe  more  linear  slope  in  fhe  overall  rellecfance  term  in 
comparison  fo  eilher  fhe  lower  rellecfance  largel  or  fhe  previous  scenario. 

Olher  fhan  magnilude,  Ihere  do  nol  appear  fo  be  any  significanl  shifls  in  behav¬ 
ior  in  fhe  underlying  correlalion  terms  shown  in  figures  D.8(a)  and  D.8(b). 

The  jagged  appearance  of  fhe  line  is  a  machine  precision  arlifacl  inherenl  in 
how  Ti  is  calculafed  by  fhe  model.  Any  curve  where  fhe  ri  confribufion  is  nonlrivial 
also  lakes  on  Ibis  appearance,  which  only  provides  informalion  already  in  evidence 
by  fhe  relalive  magnilude  of  fhe  curve  ilself. 

5.6.4  Scenarios  4  and  5  -  In-scene  sources 

Scenarios  4  and  5  simulate  in-scene  melhods  working  al  opposile  ends  of  Iheir 
precision  ranges.  Scenario  4  simulales  a  humid,  hazy  almosphere,  and  scenario 
5  simulates  a  dry,  clear  almosphere.  Because  mosl  uncerlainly  lypes  were  found 
fo  be  posilively  correlated  wifh  consliluenf  abundance,  scenario  4  is  fhe  poorer 
performer  of  fhe  Iwo,  and  scenario  5  performs  very  well.  These  resulfs  should  be 
laken  fo  bound  fhe  precision  of  model-based  inversion  algorilhms. 
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Considering  scenario  4  first,  the  wet  and  hazy  atmosphere  results  in  figure 
D.9(a)  were  below  15  reflectance  units  for  a  100%  reflector  in  the  visible  range, 
dropping  to  below  5  reflectance  units  in  the  SWIR  region.  This  is  very  high,  but 
it  is  also  the  absolute  worst  case.  Even  so,  5%  error  is  still  well-within  the  fam¬ 
ily  of  reported  results  for  the  performance  of  model-based  inversion  (Kruse,  2004; 
Kerekes,  1998).  At  20%  target  reflectance,  as  seen  in  figure  D.9(b),  the  uncertainty 
is  cut  in  half,  down  to  below  1  reflectance  unit  in  the  SWIR. 

In  the  scenario  4  20%  result,  the  classic  upwelled  radiance  contribution  (the 
cyan  curve)  is  prominent,  suggesting  aerosol  dominance  in  the  visible  region  ac¬ 
cording  to  common  knowledge.  However,  later  analysis  in  section  5.8  will  show 
that  water  vapor  also  contributes  to  upwelled  radiance.  Relative  to  their  typical 
values,  there  is  an  imbalance  in  favor  of  water  vapor  uncertainty.  Put  another  way, 
aerosol  uncertainty  in  this  scenario  was  moderate  while  water  vapor  uncertainty 
was  very  high.  This  is  quantitatively  supported.  Using  the  scenario  definitions  es¬ 
tablished  earlier,  the  signal-to-noise  ratio  (SNR)  for  water  vapor  was  2.0  cm  /  0.3 
cm  or  6.67.  For  aerosols  it  is  0.65/0.063  or  10.3.  This  condition  leads  to  upwelled 
radiance  driven  by  water  vapor  despite  aerosol’s  traditional  assertiveness  in  this 
regard.  Aerosol’s  general  relationship  to  upwelled  radiance  is  unchanged;  it  is  the 
uneven  conditions  imposed  by  the  scenario  that  skew  the  results.  As  an  aside,  the 
later  analysis  will  also  show  that  20%  reflectance  is  not  quite  dark  enough  to  man¬ 
ifest  aerosol  dominance.  Negative  correlations  between  the  model  output  terms 
actually  reduces  the  error  quite  a  bit  in  the  aerosol-only  case.  At  20%  the  error 
is  actually  at  a  minimum.  Below  20%  the  correlations  disappear,  and  the  aerosol- 
driven  upwelled  radiance  error  contribution  is  fully  visible.  A  tidbit  of  usefulness 
here  is  to  conclude,  then,  that  water  vapor  should  be  a  high  priority  for  augmented 
measurement  in  humid  environments,  especially  for  dark  targets  like  vegetation. 

Scenario  5  represents  the  best  that  model-based  algorithms  can  do  (without 
considering  any  spatial  and  spectral  convolution  or  correction  tricks).  For  the 
100%  reflector,  figure  D. 11(a)  shows  decent  performance  starting  at  just  above 
8  reflectance  units,  dropping  quickly  to  below  3  reflectance  units  of  uncertainty  in 
the  near  IR  and  short  wave  IR.  Again,  this  is  consistent  with  literature  observa¬ 
tions  of  in-scene  inversion  algorithms.  The  20%  reflector  results,  shown  in  figure 
D.  11(b),  show  retrieved  reflectance  uncertainty  under  2  reflectance  units,  and  most 
often  less  than  half  of  a  reflectance  unit.  As  with  the  previous  scenarios,  there 
is  a  strong  component  from  upwelled  radiance  counteracted  by  strong  negatively 
correlation  terms.  In  this  case,  the  water  vapor  uncertainty  is  much  lower,  but  the 
aerosol  uncertainty  is  more  or  less  the  same  as  for  the  hazy  case.  It  is  expected 
that  aerosol  uncertainty  would  dominate  because  of  this,  except  the  presence  of  the 
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correlation  terms  makes  it  hard  to  predict  exactly  which  effects  are  the  most  active. 

It  may  be  striking  just  how  different  the  results  these  two  cases  are  from  one 
another,  but  the  modeling  methodology  easily  exposes  the  cause:  the  water  vapor 
and  density  altitude  parameter  uncertainties  each  spanned  an  order  of  magnitude.  It 
may  be  standard  to  see  this  level  of  variability  between  different  classes  of  ground 
instruments,  but  it  was  also  demonstrated  earlier  that  in-scene  constituent  retrieval 
can  vary  dramatically  depending  on  atmospheric  conditions  and,  in  some  cases, 
scene  content. 

The  final  key  observation  is  that  the  uncertainties  for  the  in-scene  inversion 
algorithm  scenarios  are  higher  than  for  the  previous  scenarios.  The  best-possible 
atmospheric  determination  uses  the  ARM-grade  instrumentation.  The  reflectance 
random  uncertainty  for  scenario  3  was  1  reflectance  unit  at  its  maximum  in  the 
visible  region,  and  quickly  dropped  to  1  or  2  tenths  of  a  reflectance  unit  for  the  rest 
of  the  spectral  range.  The  best  in-scene  performance  from  scenario  5  is  roughly 
double  this,  meaning  improvement  from  truth- augmentation  would  be  possible  and 
beneficial. 

5.6.5  Scenarios  6  through  8  -  Off-nadir  pointing  bias 

Appending  E,  beginning  on  page  229,  contains  the  results  for  the  environmental 
effect  scenarios.  Scenarios  6,  7,  and  8  are  grouped  together  because  they  all  ex¬ 
plore  the  effect  of  off-nadir  pointing  on  retrieved  reflectance.  Off-nadir  pointing 
increases  the  path  length  of  the  atmospheric  column,  decreasing  the  target/sensor 
transmissivity  T2  and  increasing  the  path  radiance  L^.  A  larger  path  length  than 
what  was  assumed  by  the  model  has  the  overall  effect  of  decreasing  the  retrieved 
reflectance  as  a  negative  bias  effect. 

Figure  E.  1  shows  the  magnitude  of  this  bias  for  several  different  altitudes  and 
pointing  angles  over  a  100%  reflectance  target.  Different  sensor  instruments  have 
a  wide  range  of  architectures  such  that  one  instrument  would  never  capture  a  scene 
outside  more  than  a  degree  or  two  field  of  view,  whereas  another  may  scan  a  view¬ 
ing  swath  of  30°  or  more.  These  sensors  may  be  based  on  aircraft  or  spacecraft. 
For  the  worst  case  studied,  which  is  a  15°  off-nadir  shift  from  100  km,  the  negative 
reflectance  bias  was  less  than  1-2  reflectance  units.  For  a  20%  reflector,  the  bias 
was  both  positive  and  negative  but  with  a  generally  less  pronounced  effect.  For  the 
100%  reflector,  the  effect  from  the  decrease  in  transmissivity,  which  is  reflectance 
dependent,  dominated  the  effect  from  increase  in  path  radiance,  which  is  not.  When 
the  target  reflectance  is  lower,  the  transmissivity  and  path  radiance  effects  are  more 
in  balance,  causing  the  surprising  curve  shapes  seen  in  figure  E.2.  For  the  aircraft 
height,  the  differences  were  almost  negligible,  and  from  the  spacecraft  height,  the 


150 


CHAPTER  5.  RESULTS  AND  DISCUSSION 


bias  was  small  but  nontrivial. 

Because  the  position  of  the  sensor  is  known,  this  error  source  is  a  geometric 
effect  that  can  and  should  be  removed  systematically.  Modeling  should  account 
for  the  path  length  changes  either  by  directly  specifying  them  or  by  detecting  the 
increased  quantities  of  water  vapor  or  aerosols  using  in-scene  methods.  Even  if  the 
bias  is  ignored,  both  narrow  and  wide  field-of-view  spacecraft  should  not  suffer 
greatly  in  reflectance  retrieval,  unless  of  course  accuracy  to  within  2  reflectance 
units  of  1  O'  uncertainty  is  desired. 

5.6.6  Scenarios  9  and  10:  Off-nadir  pointing  uncertainty 

Scenarios  9  and  10  show  the  effect  of  inaccurate  knowledge  of  pointing  angle. 
Figure  E.3  shows  bias  error  on  the  order  of  8  x  10“®  for  a  100%  reflector  and  1° 
pointing  knowledge.  Typical  pointing  accuracy  is  on  the  order  of  milliradians,  and 
can  be  as  low  as  microradians.  This  effect  can  be  safely  ignored. 

5.6.7  Scenario  11:  Ground  tilt  bias 

Ground  tilt  bias  is  one  of  the  most  problematic  effects  that  can  be  modeled.  The 
cosine  effect  causes  rapid  change  to  perceived  ground  target  reflectance  after  a 
small  change  in  relative  tilt  angle.  This  is  clearly  seen  in  figure  E.4(a),  where 
negative  bias  approaches  20  reflectance  units  for  a  100%  reflector  and  15°  tilt. 
However,  in  the  more  restrained  case  of  a  3°  tilt,  the  negative  bias  to  retrieved 
reflectance  is  2-3  reflectance  units.  The  results  for  the  20%  reflector  case,  shown 
in  figure  E.4(b),  are  exactly  one  fifth  of  those  for  the  100%  reflector. 

It  is  dangerous  to  understate  the  impact  of  bias  error  effects.  Whereas  a  1  sigma 
random  error  result  would  predict  that  68%  of  the  time  the  result  will  fall  within 
±3  reflectance  units  of  the  true  value,  often  very  close  to  the  true  value.  With  a  bias 
error,  there  is  a  100%  guarantee  that  the  retrieved  value  will  differ  from  the  true 
value  by  3  reflectance  units.  A  20  reflectance  unit  difference  for  a  100%  reflector  is 
20%  guaranteed  error  on  top  of  all  random  uncertainty  that  applies  to  the  retrieval. 

5.6.8  Scenarios  12-13:  Ground  tilt  knowledge  uncertainty 

It  is  charity  to  limit  tilt  angle  knowledge  to  10°  or  less.  Even  in  cases  where  the 
actual  angle  is  small  (5°  or  less,  as  shown  in  figures  E.5(a)  and  E.5(b)),  knowing 
that  the  ground  tilt  angle  is  bounded  to  within  10°,  a  pittance  for  hilly  ground, 
introduces  uncertainty  of  10-12%  reflectance  in  final  retrieved  reflectance  for  a 
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100%  reflector.  A  more  ambitious  assumption  of  2°  angle  knowledge  results  in  a 
more  manageable  2  reflectance  unit  uncertainty  in  final  reflectance. 

The  impact  of  knowledge  error  in  the  case  of  inverting  reflectance  of  highly 
sloped  terrain  (figures  E.5(c)  and  E.5(d))  is  considerably  worse  in  all  but  the  best 
of  situations.  This  represents  a  case  where  a  slope  is  known  to  exist,  but  it  may 
vary  by  a  couple  of  degrees.  If  inversion  is  being  conducted  over  a  sloped  surface 
known  with  2°  uncertainty,  the  same  2-3  reflectance  unit  uncertainty  is  predicted 
to  be  present. 

Other  than  the  tendency  for  the  ground  to  be  flat,  there  is  no  limit  to  the  havoc 
hills  and  slopes  can  wreak  on  the  remote  sensing  of  bright  targets.  In  general,  the 
imaging  scientist  has  zero  knowledge  of  the  local  ground  tilt  angle.  Model-based 
algorithms  are  powerless  to  detect  and  compensate  for  non-systematic  ground  tilt 
variations  without  the  help  of  active  sensors,  though  it  may  be  possible  to  detect 
and  correct  for  a  constant  slope  across  a  scene.  When  it  comes  to  darker  targets, 
the  outlook  is  more  optimistic.  As  shown  in  figure  E.5(d),  the  impact  of  ground  tilt 
uncertainty  is  bounded  to  within  approximately  3^  reflectance  units  for  the  20% 
reflector,  with  a  most  likely  best  case  impact  of  half  a  reflectance  unit  or  less. 

There  is  no  refuge  for  the  imaging  scientist  other  than  to  use  apparent  re¬ 
flectance  or  hope  that  an  assumption  of  flatness  to  within  2°  (184  feet  of  elevation 
change  per  mile)  is  valid.  Apparent  reflectance  is  a  time-stable  material  property 
that  affects  reflectance  in  a  manner  similar  to  a  target  being  in  shadow.  Many  imag¬ 
ing  algorithms  can  deal  with  a  shadowed  targets,  either  explicity  as  a  separate  class 
or  by  using  brightness-insensitive  metrics  such  as  spectral  angle  (though  this  is  not 
to  say  that  targets  are  not  spectrally  altered  by  either  shadow  or  tilt  effects  -  they 
are).  Therefore,  the  overall  contribution  of  target  tilt  to  absolute  reflectance  error 
can  be  high  but  the  impact  to  perceived  reflectance  and,  subsequently,  the  imaging 
science  application  of  the  retrieval,  can  be  low. 

5.6.9  Scenarios  14-17:  Bias  error  due  to  cloud  cover  and  background 
objects 

Clouds  and  background  objects  are  both  difficult  to  model  and  discuss.  It  is  nearly 
impossible  to  generalize  about  clouds  because  their  geometric  and  radiometric 
character  are  so  variable  that  any  analysis  and  conclusions  are  applicable  only  to 
the  conditions  modeled  and  those  specific  results.  The  attempt  here  was  to  divide 
the  variability  space  into  cloud  type  families  and  show  a  bias  spread  based  on  geo¬ 
metric  configuration.  The  contributions  of  cloud  cover  to  reflectance  retrieval  error 
are  obvious,  but  because  they  add  direct  bias  to  the  retrieved  reflectance,  it  is  dif¬ 
ficult  to  integrate  them  into  a  sensor  network  based  on  uncertainty  reduction.  In 
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other  words,  adding  a  diffuse  radianee  sensor  to  the  network  should  theoretieally 
reduee  single-point  eloud/baekground  bias  to  zero,  a  simple  and  elegant  solution  to 
the  problems  eloud  eover  and  terrain  masking  pose.  The  validity  of  this  approaeh 
has  not  been  fully  explored. 

Figures  E.6  and  E.8  show  eloud  and  baekground  bias  results  for  a  100%  reflee- 
tor.  Eigures  E.7  and  E.9  show  the  same  for  the  20%  refleetor. 

Beeause  elouds  are  volatile,  it  is  futile  to  model  a  given  sky  eonfiguration  and 
hope  to  mateh  it  to  aetual  eonditions  if  the  imagery  is  eolleeted  over  any  appreeia- 
ble  time  span.  The  statistieal  approaeh  provides  a  family  of  eurves,  eaeh  of  whieh 
eorresponds  to  the  quantity  speeified,  i.e.  10%  or  20%  eloud  eover.  There  is  no 
speeifieation  of  where  those  elouds  are  loeated  in  the  sky,  and  if  the  10%  eover  is  at 
the  horizon,  then  the  eontribution  is  mueh  different  than  if  the  elouds  are  overhead 
or  near  (but  not  bloeking)  the  sun.  The  same  is  true  for  baekground  objeets  to  a 
lesser  extend,  with  the  exeeption  that  terrain  masking  ean  be  known  and  measured 
for  eaeh  point  in  the  image.  The  spatial  eomponent  is  eaptured  by  the  width  of 
eaeh  eurve  family.  The  maximum  and  minimum  eurves  are  the  theoretieal  limits 
to  the  eontribution  of  elouds  and  baekground,  outliers  (see  figure  E.6(e))  notwith¬ 
standing. 

The  eloud  and  baekground  objeet  modeling  results  also  show  the  effeets  of  eov- 
erage  knowledge.  Eor  10%  eloud  eover  over  a  100%  refleetor,  retrieved  refieetanee 
was  negatively  biased  between  1-10  refieetanee  units,  again  depending  on  the  ge- 
ometrie  eonfiguration,  opaeity,  and  shape  of  those  elouds.  Eor  a  given  pereentage 
of  eloud  eover,  in  this  ease  10%,  the  uneertainty  in  the  eoverage  estimate  was  also 
varied.  Eigure  E.6(a)  shows  10%  ±  1%,  meaning  the  true  sky  fraetion  was  aeeurate 
to  within  1%  of  the  sky.  Eigure  E.6(b)  shows  10%  ±  5%,  or  an  estimate  aeeurate 
to  within  5%  of  the  sky  dome  area. 

Random  error  in  sky  fraetions  Fi  and  F2  still  manifests  as  a  bias  effeet  on 
final  refleefanee.  Speeifieally,  if  has  fhe  effeel  of  widening  fhe  family  of  eurves  for 
eaeh  resulf.  Eor  simplieify,  fhe  uneerfainfy  is  modeled  as  a  uniform  disfribufion 
in  fhaf  speefra  are  ineluded  or  exeluded  in  a  binary  fashion,  buf  are  never  sealed. 
Pul  anolher  way,  inereasing  fhe  uneerlainly  of  fhe  sky  fraelion  merely  inereases  fhe 
size  of  fhe  bounding  box  in  figure  5.19(b)  lo  inelude  more  speefra. 

Eor  20%  eover,  fhe  bias  ranged  from  4—15  refleefanee  unils.  Bolh  eases  repre- 
senl  a  very  signifieanl  souree  of  error,  and  Ihey  Ihemselves  are  subjeel  lo  a  greal 
deal  of  variabilily.  As  wilh  fhe  10%  eloud  eover  ease,  inereasing  from  20%  ± 
1%  lo  ±  5%  sky  fraelion  random  uneerfainfy  resulls  in  a  eorresponding  inerease 
in  fhe  eurve  family  widlh.  This  has  little  effeel  on  fhe  average  eloud  bias,  buf  fhe 
maximum  and  minimum  eloud  eonlribufions  now  move  lo  greater  exlremes. 
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For  the  20%  reflector,  the  effect  of  downwelled  radiance  is  greatly  reduced,  so 
the  negative  bias  induced  by  clouds  drops  from  1-10  reflectance  units  down  to  2-3 
reflectance  units  for  either  10-20%  cloud  cover. 

Background  objects  were  modeled  using  a  composite  spectrum  that  combines 
reflectances  from  vegetation,  asphalt,  and  building  materials.  Therefore,  this  result 
is  not  universally  applicable  because  no  actual  object  actually  has  these  spectral 
characteristics.  Because  background  objects  were  restricted  to  the  horizon,  there 
was  much  less  variability  in  bias  curves  due  to  geometric  configuration.  Also, 
specular  reflectance  is  not  modeled,  only  Lambertian  downwelled  radiance.  This 
is  a  major  weakness  of  the  background  object  module  that  can  be  addressed  in 
future  work. 

There  is  a  pronounced  spectral  character  in  the  background  object  bias  results 
that  results  from  the  composite  background  object  being  darker  than  the  sky  in  the 
visible  spectrum  and  brighter  than  the  sky  in  the  NIR/SWIR  spectral  range.  This 
manifests  as  the  bias  sign  inversion  seen  in  all  background  bias  results  for  both 
reflectors.  The  general  conclusion  here  is  that  the  background  can  both  contrast 
sharply  or  blend  in  nicely  with  the  diffuse  sky  radiance  it  obscures  depending  on 
conditions. 

Unlike  clouds,  background  objects  have  a  small  effect,  with  up  to  ±0.5  re¬ 
flectance  units  of  bias  error  for  a  100%  reflector  and  ±0.2  reflectance  units  for  the 
the  20%  reflector.  However,  unlike  random  errors,  these  biases  are  directly  added 
to  or  subtracted  to  the  final  result.  This  makes  them  powerful  drivers  in  precision 
remote  sensing. 

5.6.10  Scenario  18:  Sensor  noise 

Industry-best  instrument  precision  is  assumed  by  using  noise  curves  for  AVIRIS 
and  HYDICE.  Figure  E.IO  shows  the  impact  of  sensor  noise  propagated  to  final 
retrieved  reflectance  (via  sensor  reaching  radiance  Lsr).  Error  is  generally  limited 
to  0.2  reflectance  units  or  less,  which  amounts  to  basically  zero  contribution  when 
added  in  quadrature  to  the  other  sources.  Although  these  results  show  little  contri¬ 
bution  for  the  instruments  chosen  in  this  study,  there  is  nothing  inherent  that  limits 
the  noise  for  the  hardware  part  of  the  imaging  chain  -  sensor  noise  should  never  be 
ignored. 

5.6.11  Scenario  19:  Sensor  radiometric  calibration  bias 

Calibration  bias  was  injected  into  the  error  propagation  model  in  such  a  way  that 
attempts  to  match  reported  bias  results  for  AVIRIS  and  Hyperion.  The  result 
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is  shown  in  figure  E.  1 1 .  Accuracy  for  the  industry  standard  instruments  hovers 
around  3%  or  less,  and  as  can  be  seen  in  the  result,  this  is  not  trivial  at  all.  Re¬ 
flectance  bias  as  a  result  of  bias  in  the  sensor-reaching  radiance  is  extremely  sim¬ 
ple  to  model:  the  difference  in  radiance  is  a  simple  linear  adjustment  factor  to  the 
sensor-reaching  radiance  term,  which  is  then  combined  with  the  upwelled  radiance 
term.  This  gives  an  indicator  as  to  why  the  cal  bias  can  produce  such  dramatic 
effects. 

In  figure  E.ll(a),  the  AVIRIS  bias  for  the  100%  reflector  shows  a  change  in 
reflectance  of  1-10%  in  response  to  a  2-5%  bias  in  radiance,  with  maximum  im¬ 
pact  at  400  nm.  In  the  VNIR  and  SWIR,  the  effect  on  radiance  stays  within  ±2 
reflectance  units,  increasing  past  —5  reflectance  units  after  2400  nm.  In  figure 
E.  11(b),  the  20%  reflector  causes  the  sensor  radiance  term  is  lower  in  relation  to 
the  path  radiance  term  to  begin  with.  Therefore,  changes  in  the  sensor  radiance 
term  do  not  produce  as  much  of  a  change  in  reflectance  as  with  the  100%  reflector. 
Except  for  the  green,  blue,  and  far  SWIR  spectral  regions  (where  reflectance  bias 
climbs  to  as  much  as  4  reflectance  units),  the  effect  on  reflectance  is  within  ±2 
reflectance  units. 

Hyperion’s  hypothetical  3%  negative  bias  in  sensor-reaching  radiance  mani¬ 
fests  as  a  decrease  in  retrieved  reflectance.  The  effect  takes  on  the  shape  of  the 
upwelled  radiance  contribution  to  retrieved  reflectance,  as  it  is  relatively  larger 
compared  to  a  spectrally  constant  reduction  in  the  sensor  radiance  contribution.  A 
3%  reduction  in  radiance  results  in  a  5.5  reflectance  unit  drop  for  the  100%  reflec¬ 
tor  worst  case  at  400  nm  and  a  4  reflectance  unit  drop  for  the  20%  reflector  at  400 
nm.  The  negative  bias  improves  with  increasing  wavelength  until  a  steady  state  is 
reached  past  1000  nm. 

This  result  is  striking  when  compared  to  the  tiny  contributions  the  other  sources 
of  error  and  uncertainty  have  had  on  retrieved  reflectance.  The  AVIRIS  instrument 
in  particular  has  a  reputation  for  being  well-calibrated  and  low-noise  (look  no  fur¬ 
ther  than  the  previous  scenario  for  proof  of  this).  Atmospheric  uncertainty  and 
many  environmental  errors  can  be  reduced  to  less  than  1  reflectance  unit  using 
best-available  instrumentation  and  modeling.  However,  if  spectrally  unpredictable 
biases  of  2-5  reflectance  units  are  unavoidable  due  to  an  undetectable  instrument 
calibration  bias,  then  attention  is  warranted  here.  The  mitigating  factor  is  that  the 
calibration  bias  could  be  over-reported,  and  some  of  the  bias  exists  in  the  MOD- 
TRAN  model  used  as  the  reference.  On  the  other  hand,  Hyperion’s  11-21%  bias 
that  had  gone  undetected  or  had  drifted  since  the  pre-launch  calibration,  corrected 
down  to  approximately  3%  bias,  is  a  major  source  of  error  regardless  of  the  inver¬ 
sion  technique  used. 
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5.6.12  Scenario  20:  Bias  error  due  to  spectral  misregistration 

This  scenario  was  run  using  two  values  for  spectral  band  center  shift,  0.25  and  0.5 
nm.  Results  for  all  target  types  tested  are  shown  on  a  single  plot.  Figure  E.12  shows 
the  effect  on  reflectance  for  these  conditions.  In  general,  spectral  misregistration 
for  both  cases  fails  to  cause  a  bias  more  than  half  of  a  reflectance  units  except 
for  the  atmospheric  absorption  bands.  For  the  two  major  water  vapor  absorption 
regions  at  1390  and  1900,  the  effect  exceeds  10  reflectance  units,  but  for  the  other 
water  vapor  regions  and  the  oxygen,  ozone,  etc.  the  effect  is  to  perturb  retrieved 
reflectance  by  no  more  than  2-4  reflectance  units. 

It  is  already  known  that  spectral  misregistration  can  adversely  affect  applica¬ 
tions  that  use  absorption  bands  such  as  atmospheric  constituent  estimation.  It  may 
not  be  useful  to  propagate  errors  into  reflectance  space  because  applications  af¬ 
fected  by  spectral  cal  errors  use  radiance  to  compute  band  ratios.  While  some 
algorithms  can  detect  and  correct  misregistration  effects,  others  are  powerless  to 
do  either. 

A  study  was  conducted  to  measure  the  effect  of  spectral  registration  bias  on 
such  applications.  The  continuum-interpolated  band  ratio  (Hirsch  et  ah,  2001) 
uses  a  water  vapor  absorption  feature  at  940  nm,  shown  in  figure  5.22,  to  estimate 
the  total  integrated  water  vapor  in  the  imaging  column.  The  technique  is  very 
straightforward  and  is  described  by  equation  5.1.  More  complex  methods  exist 
to  estimate  water  vapor  from  a  band  ratio,  but  this  study  only  intended  to  show  a 
simple  case  for  discussion  purposes.  Using  the  notional  band  model  described  in 
section  4.12.2,  the  spectrum  was  convolved  using  perfect  spectral  registration  and 
perturbations  up  to  ±1  nm.  This  limit  was  selected  to  envelope  real-world  cases  of 
noted  misregistration  as  discussed  earlier. 

For  the  default  atmosphere  used  in  this  investigation,  a  wide  range  of  water 
vapor  values  ranging  from  1.4  to  2.6  cm  were  substituted  for  the  default  water 
vapor  value,  and  the  resulting  at-sensor  radiance  spectra  were  convolved  with  the 
band  model.  The  continuum-interpolated  band  ratio  was  then  computed  for  the 
perfectly-registered,  convolved  spectrum  for  each  water  vapor  input.  Then,  a  sim¬ 
ulation  was  conducted  where  the  band  model  was  biased  by  some  amount  and 
used  to  reconvolve  the  total  radiance  spectrum.  For  each  degree  of  spectral  shift, 
the  shifted,  convolved  spectrum  was  then  used  to  produce  a  band  ratio,  which  dif¬ 
fered  from  the  the  unshifted  ratio  to  some  degree.  The  relationship  between  the 
unshifted  spectrum  band  ratio  and  the  corresponding  water  vapor  input  was  used 
as  a  lookup  curve  against  which  each  shifted  spectrum  band  ratio  was  compared. 
In  this  manner,  each  shifted  spectrum,  which  corresponded  to  a  true  water  vapor 
input,  produced  a  different  water  vapor  retrieval  according  to  the  unshifted  lookup 
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940  nm  feature,  convolved  spectrum 
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(a)  Unconvolved  2  nm  spectrum 


(b)  Convolved  with  10  nm  band  model 


Figure  5.22:  940  nm  absorption  feature 


table.  The  difference  between  true  water  vapor  and  retrieved  water  vapor  is  shown 
in  figure  5.23.  The  change  in  slope  at  the  wet  end  of  the  curves  is  an  artifact  in  the 
MODTRAN  modeling  process  corresponding  to  saturation  at  the  lower  altitudes. 
The  ±  1  nm  shift  produced  small  errors  in  retrieved  water  vapor,  on  the  order  of 
hundredths  of  a  millimeter.  Except  for  the  most  extreme  cases,  measurement  er¬ 
ror  of  these  quantities  is  an  order  of  magnitude  higher,  and  these  errors  would  not 
dominate  the  error  propagation  process.  Green’s  original  observation  regarding 
spectral  registration  is  verified:  keeping  specfral  bias  fo  below  1  nm  is  necessary 
fo  confrol  errors  affribufable  fo  if.  Specfral  misregisfrafion  bias  in  excess  of  ±1  nm 
produces  correspondingly  greafer  errors  in  refrieved  wafer  vapor. 

5.6.13  Scenario  21:  Spectral  jitter  uncertainty 

Specfral  jiff er  was  fhe  final  effecl  examined  as  a  sfandalone  scenario.  Figure  E.13 
shows  random  radiance  uncerfainly  propagafed  forward  info  refiecfance  space.  Un¬ 
like  fhe  specfral  bias  case,  fhe  effecl  on  band  ralio-lype  applicalions  is  nol  as  serious 
because  fhe  expecled  value  of  fhe  radiance  (and  refleclance)  more  or  less  malches 
fhe  aclual  value,  Ihough  inversion  algorilhms  may  require  modificalion  fo  accounl 
for  fhis.  For  non-absorplion  band  specfral  regions,  fhe  added  uncerfainly  is  less 
lhan  1  refiecfance  unil.  For  fhe  lower-wavelenglh  absorpfion  regions,  refrieved  re- 
fieclance  uncerfainly  grows  from  4-6  refleclance  unifs  al  fhe  edges  and  exceeds  10 
refleclance  unifs  af  fhe  exlrema.  Because  fhe  fundamenlal  mechanism  for  simulal- 
ing  jiller  is  fhe  same  as  for  band  center  bias,  fhe  same  sensilivilies  apply  as  wilh 
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Spectral  misreg.  bias  CIBR  IPW  error 


Column  water  vapor  (gm/cm2) 


Figure  5.23:  Bias  in  retrieved  CIBR  water  vapor  resulting  from  spectral  misregis¬ 
tration  bias.  The  degree  of  spectral  misregistration  is  noted  next  to  each  curve. 


the  previous  scenario,  namely  that  target  spectra  with  high  overall  brightness  or 
sharp  changes  in  reflectance  produce  higher  uncertainty.  Additionally,  increasing 
the  magnitude  of  the  jitter  increases  the  overall  reflectance  uncertainty. 

5.6.14  Final  Scenario:  Mean  squared  error  for  combined  effects 

In  each  of  the  previous  scenarios,  single  effects  were  studied,  and  there  was  no  need 
to  create  a  term  that  combined  both  random  uncertainty  and  bias  error.  For  most  of 
the  scenarios,  one  of  these  sources  was  zero  anyway.  For  this  case,  both  bias  error 
and  random  uncertainty  are  contributors  to  the  result.  The  parameters  used  for  this 
scenario  were  listed  in  table  5.10.  To  summarize,  atmospheric  uncertainty  for  field 
quality  ground  instruments  was  used,  an  AVIRIS -quality  instrument  was  used  to 
define  sensor  noise,  nominal  pointing  uncertainty  and  ground  tilt  knowledge  were 
assumed,  and  modest  cloud  and  background  obscuration  were  used.  Clouds  were 
set  to  15%  with  knowledge  uncertainty  to  within  ±5%,  while  background  terrain 
masking  was  set  to  5%.  These  contributors  are  nearly  omnipresent,  so  it  is  key  to 
ensure  their  contributions  are  captured. 
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Mean  squared  error  was  introduced  earlier  as  the  commonly  used  standard  that 
combines  the  squared  bias  with  variance  (equation  4.7).  Bias  error  and  random 
error  each  have  distinct  meanings  in  the  context  of  measurement  uncertainty,  so 
combining  the  random  components  with  the  bias  components  creates  more  of  an 
uncertainty  metric  rather  than  a  statistically  meaningful  quantity.  Both  components 
will  first  be  shown  separately  for  the  given  scenario  and  finally  fogefher  as  mean 
squared  error. 

Bofh  clouds  and  background  rellecfance  bias  specfra  are  affecfed  nol  only  by 
fhe  fofal  sky  fraclion  buf  also  by  fhe  spafial  componenf  of  fhe  sky  and  non-sky 
elemenfs.  As  was  explained  earlier,  fhere  is  an  enfire  family  of  sky  geomefries  fhaf 
are  all  valid  solutions  fo  a  given  sky  fraclion  specificalion.  In  fhe  error  propagalion 
model,  all  curves  in  fhe  family  generafed  by  fhe  cloud  and  background  modeling 
modules  are  carried  forward  lo  fhe  final  resulls.  To  simplify  presenlafion  of  fhese 
resulls,  fhe  family  of  curves  is  described  sfalisfically  by  5  summary  curves:  fhe 
minimum,  maximum,  mean,  and  fhe  mean±l  sfandard  deviafion.  Figures  5.24 
and  5.25  show  fhe  curve  families  generafed  for  Ihis  final  scenario  for  refleclance 
bias  caused  by  clouds  and  background  objecls.  Cloud  and  background  effecl  were 
earlier  shown  fo  be  dependenl  on  fargef  rellecfance,  so  resulls  for  100%,  20%  and 
5%  refleclance  largels  are  shown.  The  5%  refleclance  large!  was  added  lo  fully 
expose  a  Irend  relaled  lo  final  mean  squared  error  and  cloud  variabilily,  which  will 
be  seen  shorlly. 


(a)  100%  reflector 


(b)  20%  reflector 


(c)  5%  reflector 


Figure  5.24:  Final  scenario  refleclance  bias,  15%±5%  cloud  cover 


The  cloud  and  background  refleclance  bias  spectta  were  added  lo  fhe  olher 
sources  of  bias  error  fo  produce  fhe  fofal  bias  error.  These  resulls  are  presenfed  for 
100%,  20%,  and  5%  ground  refleclance  largels  as  figure  5.26.  The  mosl  significanl 
effecl  lhal  can  be  seen  af  Ihis  poinl  is  lhal  fhe  range  of  bias  error  caused  by  cloud 


TOTAL  ERROR 


159 


Background  bias  (range  due  to  geometry) 


Wavelength  (nm) 

(a)  100%  reflector 


Background  bias  (range  due  to  geometry) 


Wavelength  (nm) 

(b)  20%  reflector 


Figure  5.25:  Final  scenario  reflectance  bias,  5%  terrain  masking 


and  background  object  geometry  ranges  10  reflectance  units,  from  roughly  -5  to  +5 
in  the  scenario  shown  here.  However,  this  is  only  true  for  the  100%  reflector.  For 
the  5%  reflector,  there  is  virtually  no  variability  caused  by  sky  fraction  geometry, 
on  the  order  of  tenths  of  a  reflectance  unit. 


(a)  100%  reflector 


(b)  20%  reflector 


(c)  5%  reflector 


Figure  5.26:  Total  reflectance  bias  error  for  final  scenario 


These  bias  results  were  combined  with  the  random  component  to  produce  the 
curves  in  figure  5.27.  In  this  case,  the  average  bias  error  was  used  to  compute  the 
mean  squared  error.  The  purpose  of  this  result  is  to  show  the  random  error  for  the 
final  scenario  and  how  it  notionally  combines  with  the  bias  component  to  produce 
mean  squared  error.  The  random  error  is  shown  in  red,  and  the  square  root  of  the 
mean  squared  error  is  the  black  curve.  The  components  combine  in  quadrature,  so 
it  is  easy  to  see  how  one  component  can  dominate  the  other  when  its  magnitude 
is  significantly  larger.  For  the  conditions  used  in  this  scenario,  it  is  coincidental 
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that  the  cloud  bias  tends  to  be  negative  on  the  same  order  of  magnitude  that  the 
sensor  and  other  bias  sources  tend  to  be  positive.  Because  of  this,  the  bias  error  is 
close  to  a  minimum  when  compared  with  the  random  component.  Strengthening 
or  weakening  the  cloud  contribution  would  greatly  affect  the  bias  contribution  to 
the  mean  squared  error,  as  will  be  seen  presently. 


SQRT  of  mean  sq  error  (w/  components)  SQRT  of  mean  sq  error  (w/  components) 


(a)  100%  reflector  (b)  20%  reflector 


500  1000  1500  2000  2500 

Wavelength  (nm) 


(c)  5%  reflector 


Figure  5.27:  Final  scenario  mean  squared  error.  Square  root  of  the  MSE  is  in  black. 
The  random  component  is  in  red,  and  the  bias  component  is  in  green. 


The  final  set  of  results  for  the  final  scenario  is  presented  as  figure  5.28.  The 
square  root  of  the  mean  squared  error  for  a  100%,  20%  and  5%  reflector  are  shown 
in  a  way  that  relates  the  variability  caused  by  the  geometric  variation  in  cloud  and 
background  object  configuration.  In  the  figure,  the  black  curve  is  labeled  “mean,” 
the  red  curve  labeled  “min,”  and  the  green  curve  labeled  “max.”  The  designations 
“min”  and  “max”  refer  to  the  original  magnitude  of  the  cloud  or  background  re¬ 
flectance  bias  spectrum.  In  this  case,  “min”  refers  to  the  most  negative  curve,  and 
“max”  refers  to  the  most  positive  curve.  As  was  seen  in  figure  5.24,  the  curve  of 
greatest  value  (“max”)  was  actually  closest  to  zero,  while  the  most  negative  curve 
(“min”)  actually  had  the  greatest  absolute  value.  In  calculating  the  mean  squared 
error,  all  terms  are  squared,  and  the  curve  labeled  “min”  becomes  quite  large  in 
value. 

It  may  seem  surprising  that  the  mean  value  curve  produces  the  lowest  mean 
squared  error.  This  is  due  to  the  cancelation  mentioned  earlier  between  the  negative 
clouds  and  the  positive  biases  from  the  sensor  and  other  sources.  When  the  cloud 
contribution  goes  closer  to  zero  (“max”),  the  overall  bias  grows  positive,  and  when 
the  cloud  contribution  goes  highly  negative  (“min”),  the  overal  bias  grows  more 
negative  (but  higher  in  magnitude).  The  cancelation  effect  is  best  seen  in  figure 
5.26(a)  where  the  average  curve  hovers  around  zero,  but  the  “min”  and  “max” 
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have  higher  absolute  value. 

In  figure  5.27,  a  striking  eontrast  is  revealed.  For  the  bright  target  shown  in 
figure  5.28(a),  the  variability  in  mean  squared  error  due  to  eloud  and  baekground 
objeet  geometry  ean  be  as  high  as  2  refleetanee  units  -  but  ultimately  not  as  large 
a  faetor  as  earlier  results  like  figure  5.26  might  have  suggested.  For  the  dark  tar¬ 
get  in  figure  5.28(e),  geometry  variability  is  no  longer  expressed  in  the  final  mean 
squared  error.  It  is  notable  that  the  bias  error  is  still  present,  but  it  no  longer  varies. 
It  is  is  masked  by  the  sensor  bias,  whieh  makes  a  lot  of  sense  -  elouds  bias  down- 
welled  radianee,  whose  error  eontribution  depends  on  target  refleetanee,  whereas 
the  sensor’s  eontribution  does  not. 

Some  overall  eonelusions  ean  be  drawn  from  these  results.  First,  it  ean  be  said 
that  the  random  error  sourees  are  most  important.  Bias  did  exert  some  influenee 
in  figure  5.28(a),  but  even  in  that  regime  the  magnitude  and  shape  of  the  mean 
squared  error  was  driven  by  the  random  eomponent  (and  even  more  so  in  other 
regimes).  The  mean  squared  error  varied  greatly  as  a  funetion  of  target  refleetanee 
as  it  does  for  the  random  eomponent  alone.  The  square  root  of  the  mean  squared 
error  overall  magnitude  went  as  high  as  10  refleetanee  units,  but  for  the  most  part 
it  hovered  around  a  few  refleetanee  units. 

These  results  eonfirm  behavior  seen  in  other  work,  where  differenees  between 
predieted  and  truth  data  are  eonsistently  to  within  this  bound.  It  also  illustrates  how 
the  errors  introdueed  by  atmospherie  uneertainty  ean  eelipse  the  benefits  of  having 
an  instrument  with  superb  noise  eharaeteristies,  as  was  mentioned  at  the  start  of 
the  last  ehapter. 

Final  scenario  variant 

The  last  set  of  observations  to  be  made  for  this  ease  requires  a  modifieation  of  the 
seenario  parameters.  Whereas  the  final  seenario  used  “field  quality”  instruments 
eorresponding  to  those  used  in  basie  seenario  2,  it  is  demonstrative  to  reduee  the 
atmospherie  random  uneertainty  by  switehing  to  the  “ARM  quality”  instruments 
eorresponding  to  those  used  in  basie  seenario  3  (per  table  5.8).  In  the  baseline  final 
seenario,  it  was  seen  that  random  uneertainty  dominated  the  bias  eontributions. 
In  the  modified  version,  the  random  uneertainty  from  atmospherie  measurements 
will  be  greatly  redueed,  showing  what  the  transition  from  a  eheaper,  low-preeision 
network  to  a  more  expensive,  high-preeision  network  might  look  like. 

Beeause  only  random  eomponents  have  ehanged  in  this  modified  seenario,  the 
bias  errors  are  identieal  to  the  baseline  final  seenario.  The  new  mean-squared  error 
plots  in  figure  5.29  show  new  interaetions  when  the  errors  are  eombined.  With  the 
lower  atmospherie  eontribution,  the  other  error  sourees  are  more  easily  seen  in  the 
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SQRT  of  Mean  sq  err  (range  due  to  geometry) 


(a)  100%  reflector 

SQRT  of  Mean  sq  err  (ronge  due  to  geometry) 


SQRT  of  Mean  sq  err  (range  due  to  geometry) 


(b)  20%  reflector 


(c)  5%  reflector 

Figure  5.28:  Square  root  of  mean  squared  error  for  the  final  scenario  (with  geo¬ 
metric  variability  for  clouds  and  background  objects) 
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combined  mean  squared  error.  For  the  100%  reflector,  the  random  component  still 
dominates,  but  isolated  spikes  attributable  to  the  sensor  bias  affect  the  combined 
result.  The  random  component  has  a  different  shape,  however,  as  the  characteristic 
upswing  in  uncertainty  in  the  blue  spectrum  is  gone.  This  indicates  a  shift  in  dom¬ 
inance  from  atmospheric  sources  to  environmental  sources  of  uncertainty,  namely 
the  5°  random  uncertainty  in  ground  tilt.  As  the  target  reflectance  decreases,  the 
ground  tilt  random  uncertainty  also  decreases,  allowing  bias  error  to  again  become 
the  prime  contributor,  mainly  in  the  blue  spectral  region. 


SORT  of  mean  sq  error  (w/  components) 


Wavelength  (nm) 


(a)  100%  reflector 


SQRT  of  mean  sq  error  (w/  components) 


Wavelength  (nm) 


(b)  20%  reflector 


SQRT  of  mean  sq  error  (w/  components) 


Wovelength  (nm) 


(c)  5%  reflector 


Figure  5.29:  Final  scenario  variant  mean  squared  error.  Highly  precise  atmospheric 
instruments  are  modeled,  as  opposed  to  the  lower-precision  instruments  modeled 
in  the  baseline  final  scenario.  Square  root  of  the  MSE  is  in  black.  The  random 
component  is  in  red,  and  the  bias  component  is  in  green. 


Although  the  simulated  ground  sensor  suite  was  upgraded  to  a  better  set  of 
instruments  for  this  modified  scenario,  the  shift  in  dominance  to  other  error  con¬ 
tributors  suggests  a  “noise  floor”  that  proves  difficult  to  break  through.  Bright 
ground  targets  in  the  blue  spectral  region  are  the  exception,  where  the  reduction  in 
random  uncertainty  from  the  atmosphere  does  improve  the  system  performance. 

Figure  5.30  shows  how  the  modified  final  scenario’s  mean  squared  error  be¬ 
haves  in  response  to  geometric  variability  in  cloud  and  background  objects.  The 
increased  contribution  from  bias  error  sources  over  random  sources  can  be  seen 
in  the  increased  range  of  final  results  due  to  the  geometric  variability.  In  figure 
5.30(a),  the  cloud  geometry  causes  the  error  estimate  to  change  by  3-4  reflectance 
units  in  the  visible  spectral  region,  in  comparison  with  the  2  reflectance  units  for 
the  baseline  scenario.  Again,  just  like  the  baseline  scenario,  darker  targets  appear 
to  have  negligible  sensitivity  to  the  sky  fraction  geometry,  though  the  effect  is  more 
pronounced  than  before. 
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SQRT  of  Mean  sq  err  (ronge  due  to  geometry) 


(a)  100%  reflector 

SQRT  of  Mean  sq  err  (ronge  due  to  geometry) 


SQRT  of  Mean  sq  err  (range  due  to  geometry) 


(b)  20%  reflector 


(c)  5%  reflector 

Figure  5.30:  Square  root  of  mean  squared  error  for  the  final  scenario  (with  geo¬ 
metric  variability  for  clouds  and  background  objects) 


VALIDATION 


165 


5.7  Validation 

Validation  results  are  presented  in  appendix  F,  starting  on  page  243.  The  list  of 
validation  cases  is  repeated  in  table  5.11.  For  each  of  the  validation  cases,  a 
simulation  run  was  conducted  using  the  error  propagation  model,  and  one  set  of 
runs  conducted  according  to  the  methodology  described  in  section  4.15.  For  the 
Monte-Carlo  style  runs,  each  of  the  reported  atmospheric  constituents  was  vali¬ 
dated  against  the  intended  input  distribution. 


Table  5.11:  Validation  scenario  summary 


Validation  parameter 

Mean 

Std  dev 

VI 

water  vapor  -  dry 

0.75  cm 

0.2  cm 

V2 

water  vapor  -  dry 

0.75  cm 

0.1  cm 

V3 

water  vapor  -  wet 

2.0  cm 

0.2  cm 

V4 

water  vapor  -  wet 

2.0  cm 

0.1  cm 

V5 

density  altitude 

0.218  km 

0.02  km 

V6 

density  altitude 

0.218  km 

0.01  km 

V7 

aerosol  optical  depth 

0.447  (15  km) 

0.04(1.55  km) 

V8 

aerosol  optical  depth 

0.447  (15  km) 

0.02  (0.75  km) 

V9 

multiple  parameters 
water  vapor 

2.0  cm 

0.2  cm 

density  altitude 

0.218  km 

0.045  km 

aerosol  optical  depth 

0.456 

0.02 

Each  validation  result  is  the  product  of  600  MODTRAN  runs  using  the  dis¬ 
crete  ordinate  transfer  (DISORT)  algorithm.  Each  random  distribution  of  atmo¬ 
spheric  characteristics  was  verified  against  the  corresponding  desired  distribution 
prescribed  by  the  scenario  list.  Preliminary  research  using  the  less  accurate  Isaac 
2-stream  multiple  scattering  algorithm  resulted  in  a  significant  underestimation  of 
the  variability  on  the  order  of  0.5-1. 5  reflectance  units.  This  was  due  to  the  under¬ 
estimation  of  scattered  radiance  in  the  shorter  visible  wavelengths. 

In  some  cases,  the  sample  size  of  600  proved  to  be  too  small.  The  target  vari¬ 
ability  listed  in  table  4.5  was  not  achieved  exactly,  and  in  most  cases  the  difference 
was  large  enough  to  affect  the  results.  In  those  cases,  the  conditions  simulated 
in  the  validation  process  differed  from  the  uncertainties  used  to  generate  the  error 
propagation  model  predictions.  When  this  was  found  to  be  the  case,  the  error  prop- 
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agation  model  inputs  were  adjusted  to  mateh  the  eonditions  aetually  simulated, 
with  the  aetual  values  used  annotated  in  the  appendix.  The  improvement  in  model 
performanee  was  frequently  signifieant. 

The  validation  results  agree  well  with  the  model  predietions.  Although  there 
is  not  perfeet  eorrespondenee,  the  values  are  well  within  the  same  order  of  magni¬ 
tude,  and  the  eurve  shapes  are  virtually  identieal.  No  eomponent  eontribution  data 
was  eompiled  from  the  validation  runs,  so  no  basis  for  eomparison  exists  for  the 
eontribution  of  the  individual  modeling  outputs. 

Eaeh  validation  seenario  ineludes  a  plot  showing  absolute  differenee  in  abso¬ 
lute  reflee tanee  units  and  one  showing  pereent  differenee  in  relative  units.  The 
absolute  differenees  are  generally  very  satisfying,  on  the  order  of  less  than  half  of 
a  refleetanee  unit.  The  pereent  differenees  tell  a  different  story.  Beeause  the  valida¬ 
tion  seenarios  produee  sueh  small  refleetanee  uneertainty  to  begin  with,  uneertainty 
on  the  order  of  tenths  or  hundredths  of  a  refleetanee  unit  ean  eorrespond  to  5-10% 
of  the  eomparison  magnitude.  The  best  eorrespondenee  exists  within  the  visible 
speetrum,  where  the  model  predietions  generally  fall  to  within  ±5%  of  the  valida¬ 
tion  result.  In  the  non- absorption  regions  past  1  mieron,  there  are  plaees  where  the 
predietions  mateh  to  within  ±10%,  but  generally  the  small  values  involved  result 
in  wide  disagreement. 

The  faet  that  the  differenee  plot  sometimes  takes  on  the  shape  of  one  of  the 
eomponent  eurves  may  indieate  a  systematie  souree  of  error,  the  determination 
of  the  exaet  souree  of  whieh  would  require  further  study.  The  effeet  is  worst  in 
validation  seenario  3  (water  vapor  at  2.0  em  with  an  uneertainty  of  0.2  em)  and 
seenario  6  (density  altitude  at  0.218  km  with  an  uneertainty  of  0.01  km),  both  at 
20%  target  refleetanee.  However,  most  of  the  water  vapor  and  density  altitude 
seenarios  showed  at  least  a  slight  bias  or  speetrally-eorrelated  shape  at  both  100% 
and  20%  refleetanee.  In  general,  the  model  performed  worse  in  eomparison  to  the 
validation  runs  for  the  20%  refleetor  aeross  the  board.  For  the  aerosol  optieal  depth 
seenarios,  there  was  no  speetrally-eorrelated  bias,  but  the  spread  in  the  results  was 
mueh  greater  for  the  20%  refleetor  than  for  the  100%. 

All  of  the  validation  seenarios  tested  a  single  parameter  exeept  for  the  last, 
whieh  set  eaeh  parameter  to  the  uneertainty  values  used  in  seenario  2.  The  simu¬ 
lation  parameters  were  eorreeted  to  mateh  the  aetual  statistieal  distributions  gen¬ 
erated  in  the  validation  proeess.  The  final  validation  seenario  had  the  best  eorre¬ 
spondenee  between  the  model  and  simulation  results.  In  the  visible  speetrum,  the 
diserepaney  was  below  ±3%,  whieh  is  eonsidered  extraordinary.  Furthermore,  the 
pereent  differenee  was  below  ±10%  up  until  the  first  major  absorption  region  at 
1390  nm  and  above  the  seeond  major  absorption  region  at  1900  nm. 
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Vagaries  of  the  error  modeling  process  could  explain  the  discrepancies  between 
validation  and  prediction  results.  The  most  likely  candidate  is  machine  precision  in 
MODTRAN’s  outputs.  Because  these  results  are  so  small,  they  would  be  sensitive 
to  a  loss  of  significant  bits.  It  has  been  shown  that  the  precision  of  slope  determi¬ 
nation  is  affected  by  the  limited  number  of  significant  figures  provided  by  MOD- 
TRAN  oufpuf  (and  possibly  carried  along  in  fhe  compufafion  ilself).  An  adjusfmenf 
of  paramefers  wifhin  fhe  significanl  precision  limifs  of  fhe  model  would  definitely 
cause  discrepancies,  fhough  fhe  exacf  confribufion  of  fhese  errors  is  probably  nol 
possible  fo  determine  wifhouf  examining  fhe  inner  workings  of  fhe  radiative  frans- 
fer  code. 

In  addifion,  fhe  ri  ferm  is  a  term  nol  direclly  accessible  in  fhe  MODTRAN 
oufpuf,  ralher,  if  musl  be  derived  from  several  olher  oulpuls.  If  roulinely  shows  fhe 
effecls  of  precision  Iruncalion.  This  is  mosl  clearly  visible  in  figure  D.3(a),  where 
fhe  red  ri  curve  shows  a  jagged  appearance  where  fhe  olher  curves  are  smoolh. 
Any  curve  lo  which  fhe  red  curve  is  a  significanl  conlribulor  also  picks  up  Ibis  high 
frequency  “noise,”  as  fhe  correlalion  ferm  and  lolal  error  curves  do  in  lhal  plof. 
This  jaggedness  is  visible  in  fhe  correlation  term  curves  for  many  of  fhe  validafion 
scenarios  and  qualilalive  appears  fo  be  responsible  for  fhe  many  oulliers  in  fhe 
percenl  difference  plols. 

The  olher  possible  source  of  error  is  from  fhe  assumplions  inherenf  in  fhe  mod¬ 
eling  approach.  Firsl  is  fhe  Iruncalion  of  fhe  Taylor  series  lhal  serves  as  Ihe  foun¬ 
dational  process  of  Ihe  error  propagation  model.  The  correlalion  terms  are  plainly 
seen  lo  make  significanl  conlribulions  lo  Ihe  final  result  The  loss  of  higher  order 
terms  usually  means  a  change  in  precision  2  or  3  orders  of  magnilude  below  Ihe 
level  of  real  impacl,  bul  again,  Ihe  differences  involved  here  operate  wilhin  lhal  er¬ 
ror  regime.  Similarly,  Ihe  assumption  of  linearity  may  or  may  nol  have  an  impacl, 
depending  on  Ihe  non-linearity  of  Ihe  parameter.  Despite  Ihe  differences  observed, 
Ihe  overall  level  of  agreemenl  belween  model  predictions  and  Ihe  Monte  Carlo- 
style  simulation  resulls  leads  lo  Ihe  conclusion  lhal  consliluenl  error  is  validly  and 
correclly  propagated  into  refleclance  space. 


5.8  Error  sensitivity  study 

The  resulls  in  appendices  D  and  E  show  Iraceabilily  to  Ihe  modeling  oulpuls  and 
environmenlal  effecls,  bul  nol  to  Ihe  almospheric  consliluenls.  A  sludy  was  per¬ 
formed  in  which  each  Ihe  uncerlainly  for  each  almospheric  consliluenl  was  sel  to 
zero,  and  Ihe  reduction  in  lolal  uncerlainly  was  recorded. 

The  concepl  is  lhal  Ihe  relative  magniludes  of  uncerlainly  reduction,  peak  nor- 
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malized  to  the  starting  uncertainty,  shows  the  relative  strength  of  each  constituent 
in  driving  total  uncertainty  in  retrieved  reflectance.  It  should  be  possible  to  con¬ 
clude  that  one  constituent  or  another  is  the  most  important  to  measure  for  a  given 
set  of  conditions. 

In  addition  to  measuring  the  three  primary  constituents  under  study,  a  fourth 
scenario  was  added,  namely  the  simultaneous  direct  measurement  of  downwelled 
radiance  and  sun-to-ground  transmissivity.  This  attempts  to  simulate  the  addition 
of  a  ground  photometer  that  only  measures  these  quantities.  It  is  possible  to  have 
constructed  another  scenario  case  around  this  configuration,  but  this  format  was 
just  as  convenient  and  allows  direct  comparison  between  constituent  measurement 
or  model  output  measurement. 

Appendix  G  (starting  on  page  263)  shows  results  of  the  study,  with  one  set 
of  results  for  each  of  the  5  basic  scenarios  listed  in  table  5.8.  For  each  of  the 
5  basic  scenarios,  results  are  presented  for  three  target  reflectances,  with  a  5% 
reflector  added  to  the  usual  100%  and  20%  reflectors.  This  is  because  an  effect 
was  discovered  where  the  interaction  between  correlation  terms  causes  error  to 
reach  a  minimum  not  at  0%  target  reflectance,  but  closer  to  20%.  It  was  necessary 
to  show  a  truly  dark  target,  in  the  form  of  the  5%  reflector,  to  show  how  the  error 
behavior  shifts  first  in  one  direction  and  then  in  the  other. 

In  addition  to  the  direct  study  results,  summary  plots  are  included  for  each 
scenario  that  show  the  total  uncertainty  as  a  function  of  target  reflectance  and  con¬ 
stituent.  This  was  necessary  because  while  the  water  vapor  error  contribution  pro¬ 
duces  a  simple  monotonic  decrease  in  error  as  a  function  of  target  reflectance,  the 
aerosol  error  contribution  shows  a  minimum  around  20%  target  reflectance.  Fi¬ 
nally,  this  same  information  is  re-presented  in  much  greater  detail  (in  the  form  of 
complete  results  for  each  target  reflectance  and  error  constituent)  to  elucidate  this 
more  complex  interaction. 

5.8.1  Scenario  1 

The  first  set  of  results  are  for  scenario  1,  which  is  the  climatology-based  model- 
only  inversion.  Although  the  magnitudes  of  the  errors  are  extreme  compared  to  the 
more  likely  scenarios,  the  general  behavior  is  the  same  and  worth  discussing,  since 
the  conclusions  will  be  broadly  applicable.  Figure  G.2  shows  the  individual  con¬ 
tributions  of  each  constituent.  The  red  curve  corresponds  to  the  error  contribution 
of  density  altitude  uncertainty.  The  sensitivity  of  the  final  result  to  each  constituent 
depends  on  the  relative  magnitudes  of  the  input  uncertainties,  and  for  this  scenario 
the  air  column  density  uncertainty  is  much  smaller  than  the  other  uncertainties. 
This  will  change  in  later  scenarios,  where  the  uncertainties  balance  out  better.  Ad- 
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ditionally,  the  low  contribution  of  density  altitude  allows  the  scenario  1  analysis  to 
focus  on  opposing  contributions  from  water  vapor  vs  aerosol. 

The  blue  and  green  curves  correspond  to  the  error  contribution  of  water  va¬ 
por  and  aerosol  respectively.  To  be  more  specific,  the  blue  curve  is  the  percent 
reduction  in  reflectance  error  when  the  uncertainty  contribution  from  the  water  va¬ 
por  is  set  to  zero.  With  perfect  knowledge  of  the  water  vapor,  the  aerosol  optical 
depth  uncertainty  greatly  dominates  the  uncertainty  in  the  retrieved  reflectance. 
When  water  vapor  uncertainty  is  set  to  zero,  there  is  a  small  reduction  in  final 
reflectance  uncertainty  for  the  100%  and  5%  reflectors  but  a  large  reduction  for 
the  20%  reflector.  By  contrast,  when  aerosol  uncertainty  is  set  to  zero,  there  is  a 
great  reduction  in  overall  error  for  the  100%  reflector  but  a  small  reduction  for  the 
20%  reflector,  at  least  in  the  visible  spectral  region.  For  the  dark  5%  reflector,  the 
aerosol  contribution  again  becomes  dominant,  but  not  by  much.  It  is  also  thought 
that  the  starting  water  vapor  uncertainty  is  larger  than  the  aerosol  uncertainty  such 
that  removing  water  vapor  error  produces  greater  improvement  in  the  total  uncer¬ 
tainty  result.  However,  no  metric  has  been  proposed  to  prove  this.  Because  of  the 
exponential  relationship  between  optical  depth  and  visibility,  direct  differences  in 
signal-to-noise  may  not  be  valid. 

5.8.2  Explanation  of  counterintuitive  results 

The  trend  seems  counterintuitive:  for  a  bright  target,  effects  linked  to  ti  and  T2 
should  dominate.  These  terms  are  driven  by  water  vapor,  not  aerosols.  Alternately, 
for  dark  targets,  the  scattered  radiance  terms  and  L„  should  dominate.  These 
terms  are  driven  by  aerosols,  not  water  vapor.  A  closer  look  at  the  underlying 
results  resolves  the  seeming  reversal  of  intuition. 

Figure  G.3  shows  the  total  reflectance  uncertainties  for  multiple  reflectances 
when  each  type  of  error  is  zeroed  out.  In  figure  G.3(a),  the  aerosol  uncertainty  is 
zero,  meaning  the  results  are  driven  by  water  vapor.  Despite  the  intuitive  link  be¬ 
tween  aerosols  and  scattering,  water  vapor  does  cause  a  significant  amount  of  path 
radiance.  The  monotonic  decrease  in  total  reflectance  uncertainty  with  decreasing 
reflectance  in  the  presence  of  water  vapor  uncertainty  is  driven  by  path  radiance. 
To  prove  this,  detailed  results  for  each  individual  run  were  included  in  figure  G.4. 
The  cyan  line  in  figure  G.4(a)  represents  the  upwelled  radiance  contribution  to  total 
uncertainty.  Although  aerosol  uncertainty  is  zero  in  this  figure,  the  upwelled  radi¬ 
ance  contribution  is  significant.  It  stays  constant  all  the  way  through  figure  G.4(f), 
where  it  is  the  only  contributing  factor.  Stated  explicitly,  in  figure  G.4(f),  the  total 
reflectance  error  contribution  is  from  upwelled  radiance,  and  upwelled  radiance  is 
driven  by  water  vapor.  This  runs  counter  to  the  intuitive  thinking  that  aerosols  drive 
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path  radiance  and  water  vapor  does  not. 

However,  this  is  not  to  say  that  aerosol  uncertainty  does  not  have  a  significant 
path  radiance  contribution.  Indeed,  moving  on  to  figure  G.5(f),  a  high  upwelled 
radiance  confribufion  is  fhe  only  driver  of  refieclance  uncerfainfy.  Figure  G.5  shows 
fhe  resulfs  for  zero  wafer  vapor  uncerfainfy  confribufion,  so  aerosols  are  fhe  driver 
here.  The  upwelled  radiance  confribufion  is  acfually  higher  for  aerosol  error  fhan 
wafer  vapor,  as  if  should  be. 

The  resolufion  of  fhe  discrepancy  is  now  assisfed  by  reviewing  fhe  ofher  plofs 
in  figures  G.5  and  G.4.  Firsf,  fhe  red  and  green  fransmissivify  curves  in  figure 
G.4  are  exfremely  low  when  compared  fo  fhe  scattered  radiance  terms.  This  is  not 
expected  behavior  for  water  vapor-induced  uncertainty.  The  behavior  starts  back 
all  the  way  in  figures  5.5  and  5.6,  which  show  fhe  slope  of  ri  and  T2  wifh  respecf 
fo  each  afmospheric  consfifuenf.  The  slope  for  wafer  vapor  is  very  low  in  mosf 
of  fhe  specfral  region,  whereas  fhe  slope  for  aerosol  opfical  depfh  is  very  large. 
These  slopes  are  combined  wifh  fhe  consfifuenf  uncerfainfies  fo  produce  an  error  in 
a  modeling  oufpuf.  For  scenario  1,  fhe  aerosol  optical  depfh  uncerfainfy  is  40%  of 
fhe  wafer  vapor  uncerfainfy,  buf  fhe  sensifivify  of  fhe  fransmission  ferms  fo  wafer 
vapor  is  much  less  fhan  40%  fhan  fhaf  of  aerosols.  Lafer  in  fhe  propagafion  chain, 
slopes  are  calculated  fo  determine  fhe  relafionship  befween  each  modeling  oufpuf 
and  fhe  uncerfainfy  in  fhe  final  refieclance  relrieval.  These  sensilivilies  are  shown 
in  figure  5.31.  In  Ibis  figure,  fhe  red  and  green  curves  correspond  fo  ri  and  T2,  white 
fhe  blue  and  cyan  curves  correspond  fo  and  L^.  Nole  fhe  logarilhmic  scale  on 
fhe  y-axis.  Jusl  based  on  fhe  equalions  derived  in  appendix  A,  fhere  are  al  leasl 
4  orders  of  magnifude  befween  fhe  fransmission  ferms  and  fhe  scattered  radiance 
ferms.  By  ilself.  Ibis  is  nol  meaningful  because  fhe  error  in  fhe  radiance  terms  are 
several  orders  of  magnitude  below  the  error  in  the  transmission  terms.  But,  when 
traced  forward  to  this  point,  the  slope  differences  noted  earlier  are  magnified.  This 
produces  fhe  uninluilive  buf  frue  resull  lhal  aerosols  do  have  a  significanl  effecl  on 
fransmission  even  when  wafer  vapor  does  nol.  The  inluilive  behavior  is  upheld,  buf 
fhe  relalive  magniludes  of  fhe  numbers  involved  cause  fhe  lerm  dominance  fo  vary 
by  silualion. 

The  red  and  green  fransmissivify  curves  in  figure  G.5  show  whaf  happens  when 
fhe  aerosol  uncerfainfy  is  fhe  dominanl  lerm.  As  explained  earlier,  a  sufficienlly 
high  aerosol  uncerlainly  can  drive  fransmissivify  independenlly  of  wafer  vapor  and 
fo  degrees  in  excess  of  fhe  wafer  vapor’s  influence.  This  is  shown  in  figures  G.5(a) 
Ihrough  G.5(e),  where  decreasing  refieclance  causes  a  decreasing  confribufion  from 
fhe  fransmission  terms.  The  upwelled  radiance  confribufion  is  conslanl,  however, 
unlil  figure  G.5(f),  where  if  is  fhe  only  conlribufor.  Indeed,  fhe  Iransilion  in  influ- 
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Figure  5.31:  Reflectance  uncertainty  sensitivity  to  component  terms.  The  curves 
are  colored  according  to  the  legend  in  figure  D.l. 


ence  from  transmission  to  path  radiance  is  seen  in  figure  G.3(b),  where  the  jagged 
curves  (driven  by  jaggedness  in  the  ti  contribution)  give  way  to  the  smooth  expo¬ 
nential  slope  for  20%  and  0%  reflectors  (driven  by  the  upwelled  radiance  contribu¬ 
tion). 

The  correlation  terms  are  the  other  major  factor  at  play.  The  violet  line  repre¬ 
sents  the  sum  of  all  correlation  terms.  There  is  a  strong  negative  correlation  for  all 
of  the  aerosol-only  plots  in  figure  G.5  that  pulls  the  final  uncertainty  below  some 
of  the  component  uncertainties.  The  decrease  in  correlation  with  lower  reflection 
actually  allows  the  reflectance  uncertainty  to  increase  for  the  aerosol-only  plots  in 
figure  G.5.  In  figure  G.4,  the  correlation  is  positive  and  stays  positive,  so  there  is 
no  trend  reversal  in  reflectance  uncertainty. 

The  combined  effect  of  these  various  factors  causes  aerosols  to  remain  the 
dominant  error  contributor  for  the  100%  reflector.  The  black  curve  of  figure  G.5(a) 
shows  a  max  error  contribution  in  the  low  wavelengths  of  approximately  0.6  or 
60  reflectance  units.  Figure  D.3  shows  the  full  error  total  in  this  spectral  region 
of  approximately  70  reflectance  units.  By  contrast,  the  reflectance  result  in  figure 
G.4(a)  shows  a  max  error  contribution  of  only  approximately  43  reflectance  units. 
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When  the  refleetanee  drops  to  20%,  the  highly  negative  eorrelations  present  in  the 
zero-water  vapor  error  ease  show  a  greatly  redueed  eontribution  from  the  aerosol 
uneertainty.  The  maximum  eontribution  is  seen  in  figure  G.5(e)  to  be  only  approx¬ 
imately  12.5  refleetanee  units.  In  eontrast,  the  error  eontribution  from  water  vapor 
uneertainty  is  seen  in  figure  G.4(e)  to  have  deereased  by  mueh  less  down  to  approx¬ 
imately  27  refleetanee  units.  The  higher  error  eontributor  in  eaeh  regime  beeomes 
the  larger  pereent  reduetion  in  figure  G.2. 

Another  effeet  eaused  by  the  eorrelation  faetors  is  that  the  pereent  reduetions 
will  not  add  to  100%.  When  one  term  or  another  dominates,  the  eorrelation  fae¬ 
tors  serve  to  either  boost  or  depress  the  total  refleetanee  uneertainty,  depending 
on  the  speeifie  atmospherie  eontributions.  This  is  an  inherently  non-linear  pro- 
eess.  For  example,  throughout  this  diseussion,  density  altitude  has  been  barely 
mentioned.  In  figure  G.2,  it  barely  registers  a  ehange  beeause  it  is  dwarfed  by 
the  other  eontributors.  One  might  expeet  the  density  altitude-only  situation  to  pro- 
duee  a  very  small  refleetanee  uneertainty.  However,  when  density  altitude  is  the 
only  error  eontributor,  the  maximum  overall  refleetanee  uneertainty  in  the  visible 
regime  is  approximately  10  refleetanee  units  (eompared  to  approximately  70  for 
all  eonstituent  eontributions).  The  interaetion  between  atmospherie  eonstituents 
via  eorrelation  terms  makes  a  linear  eombination  model  impossible  to  eonstruet. 

5.8.3  Scenarios  2  and  3 

Results  for  seenarios  2  and  3  are  shown  in  figures  G.6  and  G.IO.  The  supporting 
plots  of  underlying  eontributors  are  ineluded  for  eompleteness,  but  they  show  the 
same  general  trends  diseussed  earlier.  In  faet,  the  same  eonelusions  ean  be  made  for 
these  seenarios.  For  bright  targets  and  this  geometrie  eonfiguration,  aerosols  eon- 
tribute  the  most  uneertainty  (exeept  for  the  water  vapor  absorption  bands),  while 
water  vapor  eontributes  the  most  uneertainty  for  the  20%  refleetor. 

An  interesting  effeet  oeeurs  between  seenarios  2  and  3  for  the  truly  dark  target 
at  5%  refleetanee.  In  seenario  2,  water  vapor  is  the  heaviest  error  souree  in  the 
5%  ease,  but  in  seenario  3,  the  aerosol  eontribution  is  eompletely  dominant,  as 
would  expeeted.  The  explanation  for  this  again  foeuses  on  the  initial  uneertainties. 
Seenario  2  uses  low-quality  instrument  sourees.  However,  beeause  the  trade  spaee 
for  aerosol  profile  sensors  does  really  not  have  a  “low-end,”  seenario  2  aetually  has 
mueh  higher  quality  (and  higher  eost)  aerosol  sourees  than  it  should.  Seenario  2 
baseline  aerosol’s  uneertainty  is  lower  than  the  water  vapor  uneertainty,  whieh  is 
quite  high,  relatively  speaking.  Beeause  of  this,  redueing  the  aerosol  uneertainty  in 
seenario  2  does  not  produee  a  drastie  effeet  beeause  the  eonstituents  were  not  on 
equal  footing  to  begin  with. 
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In  scenario  3,  the  instruments  are  all  high-quality,  and  the  starting  uncertainty 
contributions  are  more  balanced  to  begin  with.  Reducing  the  aerosol  uncertainty 
has  the  expected  effect  of  greatly  reducing  the  overall  uncertainty  for  the  5%  re¬ 
flector.  Even  in  the  20%  case  water  vapor  uncertainty  has  a  reduced  influence 
compared  to  scenario  2. 

Because  the  overall  precision  of  the  instruments  used  to  measure  water  vapor 
and  aerosols  is  greatly  improved  for  scenario  3,  density  altitude  becomes  a  non¬ 
trivial  contributor  for  the  20%  target.  However,  it  does  not  dominate  water  vapor 
uncertainty  in  this  regime.  For  darker  targets,  density  altitude  again  fails  to  signifi¬ 
cantly  influence  the  results. 

5.8.4  Scenario  4 

The  error  reduction  studies  for  the  model-based  inversion  algorithm  scenarios  pro¬ 
duce  results  that  are  in  accordance  with  behavioral  observations  made  elsewhere. 
In  scenario  4,  the  100%  reflector  shows  in  figure  G.  14(a)  that  aerosols  are  the 
greatest  contributor  for  the  majority  of  the  spectral  region.  For  a  bright  target,  it 
is  expected  that  water  vapor  effects  dominate,  and  they  do  in  the  short  wavelength 
visible  region.  In  the  NIR  and  SWIR,  water  vapor  rapidly  falls  in  influence,  allow¬ 
ing  aerosols  to  take  over  in  that  region. 

For  the  20%  reflector  (figure  G.  14(b)),  the  same  seemingly  strange  water  vapor 
dominance  is  again  present.  The  key  to  understanding  this  behavior  lies  in  figure 
G.  15.  For  the  water  vapor-only  error  plots,  there  is  a  tight  distribution  ranging 
from  6-12  reflectance  units,  so  at  the  low  reflectances  there  is  still  a  high  degree 
of  water  vapor-induced  error.  In  contrast,  the  error  attributable  to  aerosols  is  much 
more  volatile  in  response  to  changes  in  reflectance.  As  was  stated  earlier,  this  is 
due  to  the  cross-correlation  interactions  between  the  modeling  outputs.  This  error 
decreases  with  decreasing  target  reflectance,  reaches  a  minimum  around  20%  target 
reflectance,  then  increases  again  with  even  darker  targets.  It  is  safe  to  conclude 
that  for  this  geometric  configuration,  the  heuristic  of  associating  dark  targets  with 
aerosol  scattering  is  probably  only  valid  for  truly  dark  targets,  defined  as  those 
under  10%  reflectance.  Value  is  gained  in  measuring  water  vapor  very  accurately 
first,  then  aerosols. 

5.8.5  Scenario  5 

Scenario  5  produced  some  unusually  shaped  results.  Figure  G.18  shows  that  for 
both  the  100%  and  20%  reflectors,  aerosols  are  worth  measuring  for  visible  target 
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applications.  Due  to  the  unbalancing  in  relative  magnitudes  in  the  error  inputs  cho¬ 
sen  for  each  scenario,  scenario  5  sees  a  shift  in  favor  of  highly  accurate  water  vapor 
over  less  accurate  aerosols.  Recall  that  for  scenario  4,  the  water  vapor  uncertainty 
was  higher  than  aerosols  in  relation  to  the  assumed  constituent  abundances.  There¬ 
fore,  as  can  be  seen  in  figure  G.19,  the  aerosol-only  errors  start  at  8  reflectance 
units  for  the  brightest  targets.  In  contrast,  water  vapor  again  has  a  very  tight  range 
that  stays  between  1  and  2  reflectance  units,  depending  on  target  brightness.  There¬ 
fore,  aerosol  is  clearly  the  main  contributor,  and  reducing  it  produces  the  greatest 
improvement  in  retrieved  reflectance  uncertainty. 

For  the  20%  reflector,  aerosols  show  that  drastic  decline  as  target  brightness 
decreases,  eventually  reaching  parity  with  the  always-low  water  vapor  contribution. 
At  this  lower  brightness,  aerosols  only  dominate  at  the  lowest  wavelengths.  In 
figure  G.  19(b)  the  highly  sloped  curve  below  500  nm  allows  that  brief  span  of 
aerosol  dominance,  but  note  that  the  aerosol  error  contribution  dips  nearly  to  zero. 
This  is  again  due  to  the  interaction  of  cross-correlation  terms.  Because  the  aerosol 
contribution  is  so  low  locally,  the  water  vapor  contribution  spikes  around  750  nm. 
For  the  remainder  of  the  spectral  region,  the  aerosol  and  water  vapor  contributions 
appear  to  be  fairly  well  balanced,  with  aerosols  remaining  the  dominant  contributor 
(except  for  the  water  vapor  absorption  bands). 

For  the  5%  reflector,  scenarios  4  and  5  show  the  same  dual  nature  as  was  seen  in 
scenarios  2  and  3.  In  scenario  4,  water  vapor  was  the  highest  error  contributor,  but 
not  as  high  as  for  other  target  reflectances.  In  scenario  5,  the  aerosol  contribution 
absolutely  crushes  the  others.  Because  the  only  difference  between  these  scenarios 
are  the  starting  constituent  uncertainties,  the  shift  in  behavior  for  dark  targets  is 
attributed  to  this  change  in  starting  uncertainties. 

Again,  for  balanced  inputs,  it  is  expected  that  aerosols  are  the  dominant  con¬ 
tributor  for  dark  targets.  For  the  other  regimes,  it  was  shown  in  the  amplification 
plots  that  the  tight  monotonic  range  of  water  vapor  error  contributions  exerts  in¬ 
fluence  over  a  narrow  range  in  retrieved  reflectance  error,  while  the  aerosol  error 
contribution  varies  non-monotonically  over  a  wide  range.  The  magnitudes  of  the 
respective  ranges  depend  on  the  initial  uncertainties.  Both  the  range  location  and 
width  determine  which  effects  will  be  dominant  for  any  given  scenario. 

5.8.6  Direct  measurement  of  ri  and  La 

The  final  component  of  this  study  was  to  examine  the  possibility  of  reducing  the 
uncertainty  in  the  modeling  inputs  by  adding  a  direct  measurement  of  the  output. 
The  two  terms  that  can  be  measured  from  the  ground  are  downwelled  radiance  and 
sun-ground  transmission.  Literature  on  ground  radiometers  describes  a  best-case 
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3%  uncertainty  for  direct  radiance  and  5%  uncertainty  for  diffuse  radiance  (Michal- 
sky,  2001).  The  uncertainty  in  the  measurement  is  treated  as  a  simple  substitution, 
and  its  effect  on  the  error  is  computed.  More  complex  schemes  of  averaging  or 
filtering  (by  inverse  weighting  each  input  by  its  estimated  uncertainty)  the  multiple 
sources  was  not  considered. 

As  the  atmospheric  constituent  uncertainties  improve,  the  value  of  adding  ground 
measurements  decreases.  For  scenario  1,  the  ground  measurements  cut  the  uncer¬ 
tainty  in  half  for  a  bright  target.  For  the  dark  target,  there  is  significant  improve¬ 
ment  to  be  had  in  the  SWIR  bands,  but  none  in  the  visible  bands.  For  scenario 
2,  a  10-40%  improvement  in  error  is  possible  for  the  bright  target,  but  very  lit¬ 
tle  improvement  is  possible  for  the  dark  target.  For  scenario  3,  the  ARM-grade 
measurements  are  so  precise  that  the  light  measurement  equipment  actually  makes 
the  results  worse,  except  for  bright  targets  in  the  lower  wavelength  visible  spectral 
region  (which  may  be  really  important  to  the  application). 

For  both  types  of  targets  in  scenario  4,  the  direct  radiance  improvement  curve 
shows  direct  radiance/transmittance  measurement  is  very  effective  for  this  sce¬ 
nario,  with  5-50%  potential  reduction  in  uncertainty,  depending  on  scene  bright¬ 
ness. 

In  scenario  5,  direct  measurement  of  the  downwelled  radiance  and  sun-ground 
transmittance  is  less  effective  here  because  the  radiometer  instrument  error  is  closer 
to  the  low-end  achievable  uncertainty  from  the  in-scene  methods.  Benefits  exist  for 
bright  targets,  but  they  disappear  for  the  darker  ones. 

An  effect  not  studied  here  is  the  elimination  of  bias  error.  The  true  value  of 
adding  direct  measurement  instruments  to  a  ground  truth  network  is  to  compensate 
for  clouds.  The  state  of  cloud  modeling  needs  to  advance  before  any  results  pre¬ 
sented  on  this  topic  would  be  meaningful.  However,  the  benefit  of  trading  a  bias  of 
up  to  10  reflectance  units  for  a  3%  uncertainty  in  modeling  output  terms  should  be 
an  easy  trade  to  make. 

Not  counting  the  potential  benefits  of  bias  adjustment,  it  was  not  clear  that 
direct  measurement  of  these  factors  was  always  better  than  reducing  atmospheric 
uncertainty.  In  reality,  instruments  that  measure  these  quantities  may  also  have  the 
ability  to  perform  accurate  measurement  of  one  or  more  atmospheric  constituents. 
When  considering  this  capability  as  a  theoretical  stand-alone  addition  to  a  ground 
truth  network,  there  are  better  ways  to  improve  performance. 
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5.9  Optimal  network  design 

Undertaking  the  construction  of  a  network  of  inversion-assisting  instruments  as¬ 
sumes  certain  things.  First,  the  area  covered  by  the  network  is  a  place  of  continu¬ 
ing  long-term  and  repeated  imagery  operations.  The  cost  and  effort  of  establishing 
a  network,  populating  it  with  sensors,  and  setting  up  back-end  processing  needs 
to  be  lower  than  simply  performing  repeated  human  data  collects,  implying  a  lack 
of  access  or  need  to  travel,  that  requires  the  system  be  automated.  Finally,  the  re¬ 
mote  sensing  instrument  used  greatly  influences  the  framework  by  prescribing  an 
inversion  method  and  general  requirements  for  data  quality. 

General  considerations 

The  major  obstacle  to  creating  an  operational  instrument-only  inversion  method 
or  using  instruments  to  augment  in-scene  inversion  methods  is  that  taking  good 
ground  truth  is  hard  (Clark  et  ah,  1995;  Smith,  2004).  It  is  labor  intensive  and 
difficult  to  do  correctly  and  consistently.  If  detailed  procedures  are  not  developed 
to  use  the  ground  instruments  correctly,  the  resulting  data  will  have  nowhere  near 
the  published  precision.  This  is  especially  true  for  equipment  that  primarily  mea¬ 
sures  radiance.  Instruments  that  measure  the  atmosphere’s  physical  properties  are 
simpler,  cheaper,  more  accurate,  and  more  reliable.  However,  with  the  exception 
of  water  vapor,  it  was  found  that  these  instruments  provide  less-than-useful  data: 
density  altitude  never  drives  retrieved  reflectance  uncertainty. 

Spatial  applicability  of  any  measurement  is  a  problem  across  the  board.  Two- 
dimensional  propagation  of  error  is  driven  by  the  atmospheric  variability  across 
the  scene  and  the  effects  of  clouds.  As  distance  from  a  point  sensor  increases, 
uncertainty  should  be  modeled  as  increasing  as  well.  A  network  of  instruments 
can  work  together  to  create  an  “error  topology”  that  has  pockets  of  high  and  low 
uncertainty,  bound  on  the  low  end  by  the  instruments  themselves  and  on  the  high 
end  by  the  distance  between  the  sensors  and  atmospheric  volatility,  both  temporal 
and  spatial.  Analysis  of  2D  effects  would  be  an  ideal  and  logical  next  step  toward 
extending  this  work. 

Field-quality  instruments  can  augment  or  match  in-scene  algorithms  at  the  low 
end  of  their  performance.  Because  humid  conditions  have  the  ability  to  seriously 
confound  band  ratio  techniques,  water  vapor  measurement  is  always  a  good  option 
for  humid  areas,  as  well  as  all  other  areas,  depending  on  scene  brightness.  They 
cannot  augment  in-scene  algorithms  performing  at  their  best. 

Aeronet-quality  instruments  can  augment  any  inversion  method  or  serve  as  the 
foundation  for  an  instrument-only  algorithm  that  rivals  any  in-scene  algorithm. 
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Their  quality  is  unmatched,  as  is  their  cost.  Both  grades  of  ground  instruments 
can  readily  he  incorporated  into  Kalman-type  filtering  algorithm  that  incorporates 
many  measurements  of  differing  qualities.  While  this  was  not  examined  in  this 
work,  it  would  he  an  excellent  investigation  for  future  work. 

ELM  is  so  popular  because,  despite  its  basic  nature,  is  based  in  first-principle 
physics  and  consistently  works  well.  Panels  would  theoretically  provide  the  best 
overall  performance,  limited  to  a  best  case  reflectance  uncertainty  of  approximately 
0.5  reflectance  units,  driven  by  the  radiometer  used  to  calibrate  the  panels  (Smith, 
2004).  The  2D  spatial  applicability  of  the  calibration  is  affected  just  like  any  other 
method,  but  it  avoids  any  problems  involved  in  the  modeling  process.  Addition¬ 
ally,  network  communications  are  not  needed  because  in-scene  spectra  provide  the 
required  ELM  constants.  However,  it  is  the  also  the  most  volatile  option  -  as  soon 
as  a  layer  of  dust  or  mud  settles  on  the  panel,  the  calibration  is  useless.  Because  the 
panels  require  periodic  re-calibration,  they  do  not  integrate  well  into  an  unattended 
ground  sensor  network  and  are  considered  only  partially  network  compatible. 

An  alternative  to  panel  ELM  would  be  ground  reflectometer  ELM.  Both  re¬ 
quire  a  ground  reflectometer  instrument,  but  the  alternative  concept  would  leave 
the  instrument  in  the  field  fo  provide  continuous  measuremenf  of  a  selecfed  ground 
large!.  This  concepf  Irades  Ihe  temporal  problems  of  fhe  calibration  panels  wifh 
insfrumenf  durabilify,  cosf,  and  nefwork  complexify  problems  associated  wifh  ra- 
diomefers. 

Evaluation  factors 

Each  sensor  is  qualitatively  evaluated  against  criteria  critical  to  the  success  of  a 
network.  Data  quality  refers  to  the  precision  and  accuracy  of  the  measurements 
taken.  The  body  of  work  preceding  this  section  provides  a  way  to  cast  actual  preci¬ 
sion  into  a  common  quantitative  evaluation  framework.  The  qualitative  evaluations 
in  the  figure  stem  from  that  analysis.  The  next  factor  is  cost.  Cost  data  were  taken 
from  actual  system  costs  either  through  vendor  documentation  or  interaction  with 
those  familiar  with  the  hardware.  Temporal  stability  is  another  key  factor  that  refers 
to  how  long  a  sensor  can  remain  unattended  without  repeated  calibration  or  adjust¬ 
ment.  If  a  sensor  cannot  hold  a  calibration,  then  it  is  not  useful  in  a  ground  network. 
The  2D  spatial  factor  refers  to  how  well  a  single  point  reading  applies  to  the  rest  of 
the  scene.  These  were  all  set  to  the  same  color  because  the  relevant  drivers  are  gen¬ 
erally  not  sensor  dependent,  though  in  truth  there  might  [literally]  be  tine  shades 
of  distinction  between  the  candidates.  Net  readiness  is  a  factor  that  evaluates  how 
well  a  sensor  can  be  inserted  into  a  network  and  run  in  an  autonomous  fashion. 
Sensors  that  require  regular  human  interaction  were  downgraded  in  this  category. 
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It  was  assumed  that  data  acquisition  and  network  communications  hardware  could 
be  adapted  to  any  sensor;  this  reflects  truth  unless  some  extenuating  circumstance 
comes  into  play.  Finally,  sensor  durability  was  evaluated.  Any  unattended  sensor 
needs  to  potentially  be  able  to  withstand  some  degree  of  stressing  weather,  water, 
temperature  variation,  wild  animals,  and/or  human  activity.  Sometimes  sensors  can 
be  ruggedized,  while  others  have  inherent  durability. 

Because  the  show-stopper  for  building  ground  networks  is  not  necessarily  the 
instrument’s  inherent  accuracy,  other  factors  become  essential  in  the  decision¬ 
making  process.  Instruments  must  be  able  to  produce  quality  data,  but  logistics, 
automation,  and  reliability  are  key.  Figure  5.32  shows  these  considerations  for  the 
leading  sensor  candidates. 

The  qualitative  evaluation  of  practicality  factors  for  each  instrument  is  supple¬ 
mented  by  a  quantitative  evaluation  of  each  instrument’s  relative  error  reduction 
potential,  shown  in  table  5.12.  The  table  shows  a  best  case  improvement  over  an 
existing  field  network  or  over  model-based  algorithms  alone.  The  numbers  rep¬ 
resent  the  decrease  in  reflectance  error  (0-100),  averaged  over  the  visible  spectral 
region.  The  table  is  also  broken  down  by  target  reflectance;  results  are  provided  for 
100%  reflector,  20%  reflector,  and  a  5%  reflector.  Although  absolute  values  are  not 
given,  results  can  be  related  to  the  reflectometer,  which  is  pegged  to  1  reflectance 
unit  of  uncertainty. 

Option  analysis 

The  quantitative  demonstration  in  table  5.12,  while  not  comprehensive,  does  con¬ 
firm  key  judgments  regarding  data  quality.  The  calibration  panels  and  in  situ  re¬ 
flectometer  configurations  were  held  as  the  control  case,  with  an  uncertainty  in 


Table  5.12:  Instrument  improvement  analysis  (averaged  over  visible  bands) 


Instrument 

Over  field  instruments 

100%  20%  5% 

Over  in- scene  methods 

100%  20%  5% 

Sun  photometer 

3.3 

1.7 

1.5 

6.3 

2.7 

2.7 

GPS  water  vapor 

0.5 

0.5 

0.4 

1.1 

1.5 

1.0 

Cal  panels 

4.7 

1.1 

1.2 

7.7 

2.1 

2.3 

Reflectometer 

4.7 

1.1 

1.2 

7.7 

2.1 

2.3 

Radiosonde 

0.0 

0.0 

0.0 

0.7 

1.0 

0.7 
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Data  Temporal  Net 

quality  Cost  stability  2D  spatial  readiness  Durability 


Sun 
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Figure  5.32:  Instrument  Tradeoff  Matrix.  Color  coding  indicates  satisfaction  of  the 
evaluation  parameter.  Red  indicates  a  “show-stopper”  or  disqualifying  factor.  Yel¬ 
low  indicates  suboptimal  performance  or  difficulty,  but  one  that  may  still  provide 
benefit.  Green  indicates  satisfaction  of  the  evaluation  criterion  with  few  caveats. 
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reflectance  measurement  of  1  reflectance  unit  for  all  spectral  bands.  All  reflec- 
tometer  results  in  the  table  show  reductions  in  reflectance  uncertainty  down  to  1 
reflectance  unit,  which  is  on  the  order  of  expected  performance  in  all  but  the  most 
favorable  conditions.  Any  table  entries  greater  than  those  of  the  reflectometer  indi¬ 
cate  a  reduction  in  uncertainty  below  1  reflectance  unit.  The  sun  photometer  does 
this  for  darker  targets.  GPS-based  instrumentation  provides  a  modest  reduction 
but  not  greater  than  either  the  reflectometer  or  photometer.  The  radiosonde,  whose 
data  are  perpetually  suspect  to  begin  with,  did  not  provide  much  improvement  at 
all. 

Sun  photometers  provide  a  lot  of  high  quality  data,  depending  on  number  of 
bands  and  construction.  As  ground-based  radiometric  instruments,  they  can  be 
used  to  provide  water  vapor,  aerosol  content,  and  transmissivity  independently  of 
the  scene  content.  They  are  expensive  instruments,  from  5-50  times  the  cost  of 
simpler  instruments,  therefore  the  risk  of  damaging  one  carries  high  consequences. 
The  instrument  needs  to  be  protected  from  damage  and  drastic  alignment  distur¬ 
bances.  The  degree  of  calibration  stability  is  an  instrument  dependent  risk  factor, 
but  it  would  be  acceptable  even  if  on  the  order  of  a  handful  of  months.  If  it  were 
not  for  the  cost,  this  instrument  would  be  the  obvious  choice  for  network  use. 

GPS  water  vapor  instruments  provide  an  excellent  mix  of  operability  attributes 
at  the  expense  of  data  quality.  Because  they  measure  radio  signals,  as  long  as  the 
instrument  has  line-of-sight  access  to  one  or  more  GPS  satellites,  they  function. 
The  sensors  are  simple,  can  be  made  durable,  and  are  already  in  continuous  reli¬ 
able,  autonomous  networked  operation.  These  sensors  are  also  inexpensive  to  set 
up  and  operate  (Santos  et  al.,  2007). 

Because  they  are  so  easily  changed  by  the  environment,  calibrated  reflectance 
panels  simply  do  not  have  the  ability  to  serve  in  an  autonomous,  high-accuracy 
ground  truth  networks.  They  are  suitable  to  augment  instruments  that  do  not  have 
atmospheric  sounding  bands  (low  accuracy)  or  in  areas  where  they  can  be  fre¬ 
quently  re-calibrated  or  cleaned  (not  autonomous). 

A  calibration  reference  with  a  resident  reflectance  instrument  is  a  significant 
improvement  over  calibration  panels  alone  in  that  the  updated  reflectance  mea¬ 
surements  account  for  changes  in  the  reference  over  time.  The  measurement  can 
be  automated  and  provides  good  accuracy,  on  the  order  of  0.5  to  4  reflectance  units 
depending  on  target  brightness  and  the  instrument  itself.  Although  calibrated  in¬ 
scene  targets  provide  ELM  constants  rather  than  atmospheric  constituents,  2D  spa¬ 
tial  stability  of  the  retrieved  values  remains  the  main  problem  with  the  ground  truth 
network.  Though  they  can  cost  significantly  less  than  sun  photometers,  fielded 
spectral  radiometers  share  the  same  durability  and  alignment  issues.  A  single- 
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input  radiometer  eonfiguration  requires  a  time-stable  instrument  ealibration  to  pro¬ 
vide  useful  results.  A  dual-input  radiometer  eonfiguration  would  provide  relative 
data  not  dependent  on  the  instrument’s  absolute  ealibration  stability,  but  there  are 
tradeoffs.  The  instrument  needs  to  measure  the  mueh  greater  direet  solar  irradianee 
yet  still  be  sensitive  to  ehanges  in  the  downwelled  radianee.  The  seeond  input  has 
an  independent  alignment  requirement,  making  the  system  even  more  sensitive  to 
physieal  disturbanee.  Therefore,  inerease  in  system  eomplexity  and  dynamie  range 
eonsiderations  may  prevent  a  dual  input  eonfiguration  from  being  the  better  alter¬ 
native  despite  the  better  refleetanee  results.  Also,  it  should  be  noted  that  ealibration 
targets  require  at  least  two  measurements  per  image,  whieh  multiplies  the  hardware 
requirements  for  this  option. 

Although  refleetometers  and  sun  radiometers  appear  to  be  very  similar  in  both 
operation  and  the  types  of  data  they  produee,  there  is  a  signifieant  differenee  in 
providing  an  atmospherie  eonstituent  and  a  pixel  refleetanee.  While  the  pixel  re¬ 
fleetanee  is  the  desired  end  produet  for  the  entire  seene,  extrapolating  an  ELM 
result  ean  be  trieky.  It  requires  multiple  ground  truth  measurements  for  a  range 
of  target  brightnesses,  and  the  measurement  preeision  is  potentially  brightness- 
dependent.  In  eontrast,  atmospherie  eonstituents  are  a  physieal  quantity,  not  a 
radiometrie  quantity.  They  are  non-speetral,  only  require  a  single  measurement 
to  use,  and  ean  be  determined  with  a  preeision  independent  of  seene  eontent.  So, 
while  the  sun  photometer  produets  require  radiative  transfer  modeling  to  be  effee- 
tive,  they  would  aetually  be  preferable  to  measuring  ground  target  refleetanee  at  a 
limited  number  of  points. 

Radiosondes  are  relatively  simple  instruments  that  ean  be  stored  in  a  weath¬ 
erproof  enelosure.  Their  suspeet  data  quality  and  eonsiderable  eost  are  not  the 
driving  faetors  in  rejeeting  these  for  more  widespread  use.  Their  main  problem  is 
the  faet  that  their  operation  eannot  be  automated  and  require  a  eontinuous  human 
presenee  to  launeh  the  instruments,  defeating  the  purpose  of  building  an  automated 
ground  truth  network. 

Final  Evaluation 

If  the  imaging  speetrometer  being  used  to  take  imagery  eannot  support  an  in-seene 
inversion  method,  two  options  exist.  The  low-eost,  low-quality  option  is  to  pop¬ 
ulate  the  network  with  GPS  water  vapor  instruments  and  perform  aerosol  estima¬ 
tion  with  elimatology  methods,  primarily  global  aerosol  produets  (sueh  as  MODIS 
data).  The  produets  are  not  suitable  for  pixel-by-pixel  in-seene  use,  but  they  are 
better  than  nothing.  The  field-quality  water  vapor  measurements  provide  good  wa¬ 
ter  vapor  information.  Driven  by  the  high  aerosol  uneertainty,  performanee  in  the 
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range  of  10-15  reflectance  units  of  uncertainty  is  predicted  in  the  visible  region 
and  below  10%  in  the  NIR  and  SWIR  regions.  The  high  cost,  high  accuracy  option 
is  to  add  a  sun  photometer,  microwave  radiometer,  or  combination  instrument  to 
provide  performance  on  the  order  of  1  reflectance  unit  or  less.  Unfortunately,  there 
is  not  much  trade  space  in  between  these  two  points  because  of  the  difficulty  in 
measuring  aerosols. 

If  the  remote  sensing  instrument  has  sufficient  spectral  resolution  to  support 
an  in-scene  inversion  method,  it  might  not  be  worth  it  to  establish  a  ground  net¬ 
work.  If  the  application  requires  an  improvement  from  the  native  5  reflectance 
units  of  uncertainty  down  to  below  1-2,  then  any  single  instrument  would  suf¬ 
fice.  After  adding  a  water  vapor  ground  sensor,  uncertainty  improvements  of  2 
reflectance  units  are  possible  for  bright  targets;  drastic  improvements  from  8  down 
to  below  4  reflectance  units  are  possible  in  the  visible,  and  uncertainty  below  half 
of  a  reflectance  unit  in  the  other  spectral  regions.  The  high  cost  option  of  using  a 
radiometer  nets  better  performance,  but  not  drastically  so  (on  the  order  of  scenario 
3’s  uncertainty). 

5.10  Summary  of  results 

Results  have  been  presented  that  show  how  the  modeling  theory  described  in  the 
last  chapter  was  assembled  into  a  error  propagation  framework  capable  of  inte¬ 
grating  modular  error  sources  into  a  cohesive  prediction  tool  in  reflectance  space. 
Additionally,  this  model  was  exercised  using  realistic  inputs  to  allow  detailed  anal¬ 
ysis  of  error  propagation  as  it  related  to  inversion  of  hyperspectral  imagery. 

In  order  to  correctly  model  the  contributions  of  each  atmospheric  constituent, 
a  partial  derivative  was  required  for  each.  Using  the  radiative  transfer  code  MOD- 
TRAN,  results  were  presented  that  demonstrate  the  process  of  numerically  cal¬ 
culating  the  partial  derivatives  of  each  modeling  output  with  respect  to  each  atmo¬ 
spheric  constituent.  Step  size  selection  was  discussed  and  presented,  and  the  slopes 
themselves  were  shown. 

Three  diverse  sources  for  atmospheric  constituent  error  were  used  to  illustrate 
the  flexibility  of  the  model.  Atmospheric  constituent  determination  by  using  his¬ 
torical  climate  data,  ground  instruments,  and  in-scene  algorithms  operate  very  dif¬ 
ferently  but  produce  identical  outputs.  Survey  results  were  presented  to  show  the 
approximate  quality  of  constituent  determination  using  each  source.  These  results 
were  then  crafted  into  5  basic  scenarios  used  to  frame  the  analysis  of  hyperspectral 
imagery  inversion. 

When  constituent  uncertainties  are  combined  with  the  partial  derivatives,  error 
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in  each  modeling  output  is  produced.  Because  this  is  an  intermediate  step,  only 
representative  results  were  shown  for  one  of  the  five  basic  scenarios,  but  the  appli¬ 
cability  of  these  results  to  the  other  scenarios  were  discussed. 

The  radiative  transfer  equation  was  decomposed  into  its  individual  compo¬ 
nents.  The  error  in  modeling  outputs  accounted  for  just  the  action  of  the  atmo¬ 
sphere  on  the  light,  but  modeling  techniques  for  the  many  non- atmospheric  effects 
was  also  discussed.  These  included  off-nadir  pointing  on  a  slant  path  through  the 
atmosphere,  clouds,  and  background  objects.  The  remaining  effect,  ground  tilt, 
was  not  presented  as  a  standalone  effect  due  to  its  simplicity:  it  directly  perturbs  the 
cosine  term  in  the  big  equation.  The  other  environmental  effects  required  more  in¬ 
volved  calculations,  and  the  results  in  radiance  space  were  presented  and  discussed 
for  each.  Additionally,  three  sensor  calibration  effects  were  presented:  radiometric 
accuracy  (bias),  radiometric  precision  (noise),  and  spectral  calibration  (which  con¬ 
tained  both  systematic  and  random  effects).  Sensor  error  models  were  taken  from 
literature  to  be  representative  of  the  state  of  the  remote  sensing  community.  The 
effects  of  these  sensor  error  models  on  radiometry  were  shown. 

Once  all  the  pieces  of  the  governing  radiative  transfer  equation  were  estab¬ 
lished  with  regards  to  impact  on  the  radiometric  environment,  all  error  sources 
were  propagated  into  the  common  reflectance  space.  Putting  together  these  pieces 
involved  iteratively  applying  the  same  basic  error  propagation  steps  described  ear¬ 
lier:  the  error  inherent  in  each  term  is  combined  with  the  partial  derivative  of  re¬ 
flectance  with  respect  to  each  term.  The  partial  derivatives,  which  are  scenario 
dependent,  were  calculated  analytically  and  used  to  produce  total  error. 

Total  error  results  were  the  centerpiece  of  this  work.  There  were  5  basic  scenar¬ 
ios  designed  to  show  the  model  predictions  of  how  well  each  source  of  atmospheric 
inversion  data  fared.  However,  a  detailed  parametric  study  was  also  performed, 
and  results  for  16  additional  scenarios  were  presented.  Each  of  these  additional 
scenarios  focused  on  one  of  the  environmental  or  sensor  error  sources  and  tracked 
how  the  error  contribution  varies  as  the  parameter  does.  One  final  scenario  was 
produced  that  attempted  to  model  a  realistic  situation  using  ground  sensors  and 
realistic  environmental  and  sensor  noise  sources. 

Model  validation  is  an  extremely  important  activity,  and  results  were  presented 
that  showed  close  agreement  between  the  model  predictions  and  a  detailed  valida¬ 
tion  study  consisting  of  9  scenarios.  Because  of  known  issues  with  machine  pre¬ 
cision  and  the  small  numbers  involved,  agreement  based  on  percentage  appeared 
to  show  significant  discrepancies,  while  agreement  based  on  absolute  deviation 
showed  close  similarity  in  both  magnitude  and  spectral  shape.  Thus,  the  results 
were  mixed  but  ultimately  deemed  to  be  acceptable. 
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Finally,  a  sensitivity  study  was  performed  and  presented  that  attempted  to  trace 
error  in  retrieved  reflectance  back  to  atmospheric  constituents.  The  results  were 
counterintuitive,  but  upon  detailed  examination  were  shown  to  be  correct.  The  rel¬ 
ative  magnitudes  of  the  atmospheric  constituent  contributions  did  not  fully  support 
intuitive  notions  of  which  constituents  dominate  which  modeling  outputs  for  two 
reasons.  First,  it  was  found  that  the  definition  of  “dark”  targets  perhaps  should 
include  10%  reflectors  and  below  -  at  20%  reflectance,  opposing  factors  work  to 
reduce  aerosol  error  effects.  Additionally,  the  relative  magnitudes  of  the  errors 
used  to  construct  each  scenario  heavily  affected  how  much  error  reduction  could 
take  place.  In  other  words,  if  an  error  is  as  low  as  it  can  go  to  begin  with,  and  an¬ 
other  constituent  suffers  from  high  error,  then  that  relationship  governs  the  result, 
rather  than  universal  principles  regarding  aerosols  or  water  vapor.  However,  the 
choice  of  parameters  and  targets  did  produce  unexpected  results,  and  it  is  perhaps 
in  situations  like  this  that  the  surprising  results  are  the  most  valuable. 


Chapter  6 

Conclusions  and  Future  Work 


6.1  Modeling  Work  and  System  Behavior 

A  foundational  body  of  work  has  been  presented  that  explores  a  subjeet  of  intense 
interest  in  a  novel  fashion.  The  study  of  radiometrie  aeeuraey  of  remotely  sensed 
imaging  and  any  derived  produets  flows  from  the  traditional  study  of  measurements 
and  uneertainty.  The  field  of  remote  sensing  is  one  of  eonstant  interaetion  between 
remote  sensing  instruments  and  the  environment  in  whieh  they  funetion.  Prediet¬ 
ing  the  eharaeteristies  of  any  element  of  this  interaetion  is  a  reeursive  spiral  of 
ealibration  and  validation  to  inereasingly  reliable  methods  and  standards.  Operat¬ 
ing  in  this  environment  demands  a  eonstant  awareness  of  error  and  uneertainty.  The 
penalty  for  ignoranee  is  not  only  not  knowing  whether  or  not  a  result  is  aeeurate, 
but  also  not  knowing  when  to  distrust  or  rejeet  the  results.  While  this  state  is  not 
unique  to  remote  sensing,  speeialized  study  of  radiative  transfer  and  atmospherie 
inversion  is  needed  to  enable  eomprehension  of  the  nonlinear  system  and  modeling 
ehallenges  inherent  in  this  task.  The  remote  sensing  produet  examined  here  was  a 
refleetanee  image  produeed  by  estimating  atmospherie  effeets  and  applying  them 
as  an  inverse  operator  to  a  radianee  image. 

A  method  has  been  developed  that  models  the  uneertainty  inherent  in  hyper- 
speetral  imagery  inversion.  Every  link  of  the  imaging  ehain  from  souree  to  deteetor 
to  inversion  algorithm  has  been  simulated  in  error  spaee  with  respeet  to  eleetro- 
magnetie  wavelength.  The  modeling  approaeh  presented  here  allows  the  unique 
speeifieation  of  the  uneertainty  in  eaeh  link  in  the  ehain  and  propagates  all  error 
sourees  into  the  eommon  framework  of  refleetanee  spaee.  Input  parameters  are 
deseribed  as  the  width  of  statistieal  distributions  governing  the  uneertainty  of  the 
individual  terms,  and  the  final  output  is  the  width  of  the  statistieal  distribution  gov- 
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erning  the  uncertainty  of  retrieved  reflectance.  The  presentation  of  this  model  is 
the  first  major  conclusion  of  this  investigation.  The  ability  to  describe  retrieved 
reflectance  error  using  statistical  language  rather  than  as  a  single  deviation  is  the 
novel  aspect  of  the  approach. 

Background  material  was  introduced  to  describe  common  inversion  methods 
and  the  physics  behind  radiative  transfer.  The  statistical  underpinnings  of  error 
propagation  were  also  presented,  including  careful  treatment  of  correlations  of 
multiple  variables.  Then,  these  two  relatively  simple  concepts  were  combined  and 
applied  to  the  various  physical  phenomena  affecting  the  spectra  reaching  an  air¬ 
borne  or  spaceborne  sensor.  Individual  models  for  each  phenomenon  were  built 
and  assembled  in  modular  fashion,  allowing  for  flexibility  and  future  growth. 

This  analytical  model  was  validated  to  the  point  where  it  credibly  reproduces 
statistical  distributions  generated  through  discrete  simulation  using  MODTRAN. 
This  self-validation  shows  that  the  model’s  key  mechanism,  the  non-linear  slope 
determination,  functions  properly.  It  also  validates  the  mathematical  theory  used 
to  propagate  error  from  precursor  sources  into  retrieved  reflectance  space.  The 
validation  did  not  treat  any  of  the  environmental  models,  but  for  the  most  part 
these  were  calculated  in  a  very  straightforward  manner.  Cloud  modeling  results 
were  not  validated,  but  these  results  were  generated  for  a  very  specific  case  using 
an  external  methodology.  In  other  words,  the  purpose  of  this  work  was  not  to 
study  cloud  modeling  per  se,  rather  given  a  valid  cloud  model,  these  effects  needed 
to  be  correctly  propagated  into  reflectance  space.  A  similar  situation  exists  with 
background  radiance. 

Populating  the  component  models  with  sample  data  was  alternately  simple  and 
difficult.  Those  portions  relating  to  the  atmosphere  and  sensing  geometry  sim¬ 
ply  require  scenario  settings  as  inputs  but  otherwise  retained  their  generality.  The 
portions  relating  to  cloud  and  background  radiance  could  not  be  used  without  spec¬ 
ifying  geometric  and  spectral  configurations  for  the  objects  themselves,  so  sample 
spectra  and  random  geometry  were  used  to  create  a  set  of  results  that  were  in¬ 
structive  but  not  general.  Similarly,  spectral  calibration  error  presented  a  modeling 
difficulty.  Except  for  spectrally  correlated  noise,  which  is  not  currently  modeled, 
spectral  calibration  error  is  the  only  effect  in  which  the  spectral  bands  are  not  in¬ 
dependent.  While  a  degree  of  generality  can  be  achieved  by  parameterizing  by  a 
spectrum’s  first  derivative,  the  overall  effect  is  unique  to  both  the  atmosphere  and 
targets.  The  loss  of  generality  is  unavoidable  at  times  but  compensated  for  by  the 
model’s  customizability. 

Aside  from  these  intricacies,  the  model  was  exercised  to  provide  insights  into 
how  different  effects  interact  and  what  relative  magnitudes  fall  out  of  a  sample  see- 
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nario.  Because  this  has  been  shown  to  be  a  valid  approach  to  predicting  uncertainty, 
it  becomes  much  simpler  to  use  the  model  as  a  tool  for  studying  uncertainty,  as  op¬ 
posed  to  a  Monte  Carlo  style  method.  Therefore,  the  second  major  conclusion  of 
this  work  is  that  observations  have  been  made  possible  by  running  the  model  with 
representative  inputs  in  a  plausible  set  of  scenarios.  Although  these  results  were 
examined  in  detail  earlier,  major  findings  are  summarized  here: 

•  Confirming  common  knowledge,  error  in  retrieved  atmospheric  transmissiv¬ 
ity  dominates  for  bright  targets,  while  error  in  upwelled  radiance  dominates 
for  darker  targets.  Downwelled  radiance  does  not  dominate,  and  its  contri¬ 
bution  scales  according  to  target  brightness. 

•  Correlation  contributions  drastically  affect  the  results.  This  is  not  an  artifact 
of  the  modeling  process;  these  terms  are  mathematically  necessary.  The 
sum  of  the  correlation  terms  may  be  positive  or  negative,  depending  on  their 
relative  magnitudes. 

•  Although  there  is  an  intuitive  tendency  to  equate  aerosols  with  scattered  radi¬ 
ance  and  water  vapor  with  transmissivity  losses,  all  atmospheric  constituents 
contribute  to  every  modeling  output.  The  relative  magnitude  of  these  con¬ 
tributions  is  so  highly  volatile  that  it  is  very  difficult  to  predict  which  effect 
dominates  the  other.  Another  factor  obscuring  relationships  that  match  in¬ 
tuitive  tendencies  is  that  when  cast  into  reflectance  uncertainty  space,  un¬ 
certainty  inputs  are  rarely  “balanced;”  in  fact,  differences  in  the  quality  of 
one  estimate  over  another  can  quickly  skew  the  relative  uncertainty  contri¬ 
butions. 

Finally,  the  model  was  used  to  show  what  improvements  could  be  possible  by 
establishing  a  network  of  one  or  more  ground  truth  sensors  to  augment  imaging  by 
a  primary  remote  sensing  instrument.  To  consistently  achieve  better  than  the  few 
percent  reflectance  that  serves  as  the  current  approximate  retrieval  limit  (depending 
on  spectral  region),  it  is  necessary,  but  not  sufficient,  to  drive  down  atmospheric 
sources  of  uncertainty.  The  results  for  the  final  scenario  and  its  variant  point  to 
several  different  ways  of  approaching  1  reflectance  unit  of  error  as  well  as  obstacles 
to  doing  so. 

For  bright  targets,  any  single  error  source,  whether  bias  or  random,  is  capable  of 
driving  the  error  above  the  few  percent  that  serves  as  the  current  lower  limit.  How¬ 
ever,  it  is  not  as  important  to  drive  error  so  low  for  bright  targets  as  it  is  for  darker 
ones.  When  compared  to  dark  targets,  the  ratio  between  retrieved  reflectance  and 
the  error  in  retrieved  reflectance  greatly  favors  bright  targets.  For  example,  using 
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performance  numbers  seen  in  the  previous  chapter’s  final  scenario,  4  reflectance 
units  of  error  for  a  100%  reflector  is  five  times  better  than  1  reflectance  unit  of 
error  for  a  5%  reflector. 

For  darker  targets,  atmospheric  uncertainty,  ground  tilt  uncertainty,  instrument 
noise  (both  random  and  non-random  components),  and  cloud  effects  can  all  be 
driven  reasonably  low  enough  to  permit  reflectance  retrievals  with  1-2  reflectance 
units  of  uncertainty.  Atmospheric  contributions  are  the  largest  contributor,  and 
driving  these  as  low  as  possible  (within  the  confines  set  by  this  research)  enables 
retrievals  at  or  below  the  1  reflectance  unit  threshold,  given  that  all  other  parameters 
are  at  the  modeled  values  and  depending  on  target  reflectance.  Several  contributors 
are  highly  volatile.  It  has  been  shown  what  the  results  could  be  given  the  example 
parameters,  but  it  would  not  be  prudent  to  generalize  further  based  on  the  particular 
sensor  chosen  for  this  scenario,  nor  the  cloud  type  or  amount.  The  conclusion 
here  is  that  assuming  the  other  parameters  are  behaving  normally,  there  is  value  in 
pursuing  a  reduction  in  atmospheric  constituent  uncertainty. 

Considerations  for  the  use  or  rejection  of  several  major  types  of  ground  truth 
instruments  were  discussed,  and  guiding  principles  for  how  to  construct  a  network 
architecture  were  offered.  Performance  improvements  for  atmospheric  inversion 
are  highly  possible  but  dependent  on  the  ability  of  the  instrument  to  provide  ade¬ 
quate  in-scene  data  to  run  one  of  the  model-based  algorithms.  High  cost  and  low 
cost  options  were  presented  and  generally  quantified,  giving  a  decision-maker  the 
tools  to  weigh  the  application-criticality  of  very  accurate  reflectance  data  with  the 
cost  of  obtaining  it. 

The  low  cost  and  modest  improvement  produced  by  ground  water  vapor  instru¬ 
ments  such  as  dual-band  GPS  made  this  instrument  the  best  marginal  improvement 
option.  Substantial  gains  in  aerosol  and  direct  irradiance  measurement  can  be  had 
at  much  greater  cost  using  a  photometer.  The  photometer’s  improvement  in  per¬ 
formance  was  unmatched,  but  it  was  only  recommended  if  the  performance  need 
justified  the  cost.  Using  both  in  concert,  of  course,  is  better  still,  and  was  predicted 
to  produce  uncertanties  on  the  order  of  j  1  reflectance  unit. 

If  the  remote  sensing  instrument  is  capable  of  supporting  model-based  inver¬ 
sion,  ground  truth  augmentation  really  isn’t  necessary  unless  the  application  re¬ 
quires  accuracy  below  2  reflectance  units  or  the  scenes  are  consistently  humid.  In 
that  case,  the  same  order  of  prescription  applies:  add  a  water  vapor  sensor  first, 
especially  for  wet  areas  where  model  based  inversion  has  trouble,  then  a  sun  pho¬ 
tometer  if  the  budget  allows. 
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6.2  Future  Work 

The  ultimate  desire  of  this  type  of  seienee  is  to  get  as  elose  to  the  unknowable 
absolute  truth  as  possible.  Truly  understanding  the  phenomenology  behind  why  al¬ 
gorithms  fail  or  why  band  ratios  fail  is  really  the  best  direetion  to  proeeed.  The  type 
of  radiative  transfer  modeling  performed  today  was  until  reeently  simply  impossi¬ 
ble  beeause  of  the  eomputing  power  required.  Today’s  radiative  transfer  is  limited 
by  the  shorteuts  and  assumptions  made  in  the  proeess.  Tomorrows  modeling  will 
eertainly  take  advantage  of  the  eomputing  tools  available  then  to  provide  even  bet¬ 
ter  modeling  eapabilities,  but  only  if  the  problems  with  the  eurrent  approaehes  are 
understood.  For  example,  there  are  hints  as  to  why  and  under  what  eonditions 
water  vapor  predietion  from  in-seene  band  ratios  have  problems,  espeeially  with 
with  wet  atmospheres,  but  the  underlying  eauses  and  modeling  oversights  are  not 
understood  well  enough  to  move  forward. 

Still  in  the  modeling  vein,  it  would  be  very  helpful  to  better  understand  the 
impaets  of  baekground  and  eloud  radianee.  Simple,  homegrown  models  were  pre¬ 
sented  here,  but  there  is  no  well-established  methodology  for  simulating  eloud 
seenes  of  different  eloud  types  and  opaeities.  Clouds  will  eontinue  to  be  the  bane 
of  remote  sensing  in  the  visible  and  near  infrared  speetral  regimes  until  their  effeets 
ean  be  better  modeled  -  not  neeessarily  from  a  spatial  standpoint,  whieh  would  be 
nearly  impossible,  but  from  a  statistieal  one. 

Also  in  the  area  of  improving  model  fidelity,  it  would  be  useful  to  study  the 
effeets  of  non-Lambertian  refleetors.  The  model  would  need  to  aeeept  a  target 
BRDF  or  at  the  very  least  a  faetor  that  aeeounts  for  the  non-Lambertian  refleetanee 
for  the  angles  under  study.  Ground  targets  that  are  brighter  or  darker  than  an  equiv¬ 
alent  Lambertian  refleetor  in  eertain  geometries  would  behave  in  error  spaee  like 
brighter  or  darker  targets.  The  previously  demonstrated  trends  in  error  propagation 
between  bright  and  dark  targets  would  eome  into  play,  and  it  would  be  useful  to 
see,  for  example,  under  what  eonditions  a  target’s  speeularity  eauses  a  erossover  in 
the  relative  importanee  of  its  error  sourees. 

Pollution  modeling  is  an  interesting  area  of  study.  The  huge  moleeules  asso- 
eiated  with  pollution  greatly  affeet  the  radianee  results,  but  these  are  not  explieitly 
treated  when  aerosols  are  diseussed  in  remote  sensing  literature.  For  that  mat¬ 
ter,  aerosol  partiele  size  distribution  and  phase  funetions  were  not  treated.  These 
ean  have  signiheant  effeets  on  the  aerosol  modeling  results  if  the  wrong  type  of 
aerosols  are  used.  Unfortunately,  no  “plug-in”  data  or  methodologies  were  avail¬ 
able  to  handle  these  properties  in  this  work,  but  they  should  be  developed. 

Sinee  pollutants  are  invariant  neither  temporally  nor  spatially,  if  error  analysis 
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ever  reaehes  the  point  of  predieting  extreme  aecuraey,  this  might  be  a  fertile  future 
study  area. 

Atmospherie  eonstituents  were  assumed  to  not  be  eorrelated,  but  a  quiek  look 
at  elimatology  plots  aeross  seasons  shows  this  is  elearly  not  the  ease.  However, 
determining  proper  eoeffieient  values  falls  in  the  realm  of  meteorology,  not  re¬ 
mote  sensing.  As  an  aside,  during  the  eourse  of  isolating  a  programming  error, 
a  eursory  study  was  eondueted  using  nonzero  atmospherie  eonstituent  eorrelation 
eoeffieients,  and  the  effeet  on  the  final  results  as  presented  here  is  small. 

With  regards  to  using  MODTRAN  as  a  slope  generator,  options  exist  but  were 
not  pursued  to  examine  the  internal  maehine  preeision  of  the  MODTRAN  eode. 
Signifieant  problems  were  eneountered  when  using  MODTRAN  in  this  manner, 
but  they  seem  to  be  reetifiable. 

In  terms  of  operating  the  model  in  support  of  error  predietion,  three  major  paths 
of  future  work  almost  seream  out.  First  is  the  need  to  examine  other  geometries 
and  loeations.  A  single  geometry  was  ehosen  to  foeus  the  work  and  its  eonelusions 
as  well  as  for  simplieity.  To  apply  the  model  to  produee  aetual  error  predietions 
and  sensitivity  information,  the  geometry  needs  to  be  reset  and  MODTRAN  slopes 
need  to  be  reeomputed  and  is  otherwise  trivial. 

Seeondly,  the  simple  method  of  eombining  inputs  eould  be  improved  through 
the  use  of  a  Kalman  filter.  This  type  of  filter  uses  data  from  all  sourees  regardless 
of  quality,  weighting  eaeh  by  its  noise.  It  reeognizes  that  all  inputs  are  useful  in 
influeneing  the  estimate. 

Ultimately,  two-dimensional  modeling  is  an  almost  mandatory  next  step.  It 
would  model  the  propagation  of  uneertainty  spatially  outward  from  the  measure¬ 
ment  point.  A  distanee  funetion  for  eaeh  error  souree  and  distanee  maps  for  eaeh 
souree  would  be  eombined  to  ereate  a  unique  uneertainty  profile  for  eaeh  pixel.  The 
uneerfainly  speefrum  would  be  eombined  wifh  fhe  pixel  speefrum  fo  predief  errors 
by  band  and  by  pixel  as  a  funefion  of  brighfness  and  speefral  eharaefer.  The  produef 
of  fhis  proeess  is  a  spafiaFspeefral  error  eube.  Fufure  work  from  fhaf  poinf  would 
inelude  fhe  addifion  of  eloud  and  ferrain  masks  fo  fold  in  fhe  kind  of  environmen- 
fal  modeling  presenfed  here.  Finally,  fhe  use  of  multiple  afmospherie  derivatives 
would  enable  fhe  eapabilify  fo  predief  error  in  a  non-uniform  in-seene  afmosphere, 
fhough  fhaf’s  probably  looking  loo  far  ahead. 
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A.l  Partial  derivatives  of  reflectance 

The  following  equations  expand  the  relevant  generalized  terms  listed  equation 
4.20: 
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dr  —^cosas'TiT2 
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—  (1  —  F2)  T2 

dLbkg 

COS  as'TlT2  +  {F2  {FiLd  +  (1  -  Fl)  Ldd)  +  (1  -  F2)  Lbkg)  T2) 

(A.8) 
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dr 

F\Ijcid  T2 

dF2  J 

^  cos  adTlT2  +  {F2  {FiLd  +  (1  -  Fi)  Ldd)  +  (1  -  ^2)  L^kg)  T2^ 

(A.9) 

dr 

—  {F2Ld  —  F2Ldd)  T2 

dFi  J 

^  cos  as'TlT2  +  {F2  {FiLd  +  (1  -  Fi)  Ldd)  +  (1  -  -^2)  Lbkg) 

r,f 

(A.  10) 

dr 

-1 

dLu 

coscj^/Ti  +  {F2  {FiLd  +  (1  -  Fi)  Ldd)  +  (1  -  -^2)  Lbkg)"^j 

1  r2 

(A.ll) 

dr 

-1 

dLadj 

coso-g/Ti  -h  {F2  {FiLd  +  (1  -  Fi)  Ldd)  +  (1  -  F2)  Lbkg) 

)n 

(A.12) 

dr 

1 

dLsR  cos  as'Ti  +  (F2  {FiLd  +  (1  -  Fi)  Ldd)  +  (1  -  F2)  Lbkg)^  T2 

(A.13) 

A.2  Correlation  and  error  terms 

In  the  following  expressions,  the  uneertainty  in  eaeh  atmospherie  parameter  is  ob¬ 
tained  either  from  a  priori  statistieal  elimate  models  of  the  area,  from  instrument 
measurements,  or  from  inversion  algorithm  outputs.  The  partial  derivatives  of  eaeh 
modeling  output  with  respeet  to  eaeh  atmospherie  parameter  are  non-linear  fune- 
tions  that  must  be  approximated  numerieally  or  through  an  appropriate  eurve  fit.  It 
is  suggested  that  numerieal  methods  be  used  beeause  the  eurves  tend  to  shift  as  the 
seenario  parameters  are  ehanged. 
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2  dn  dT2  2 
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(A.  14) 
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2  dn  dLd  2 
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+ 
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(A.  15) 
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dH20  dH20  ^  dalt  dalt  ^  dAOD  dAOD 
f  dn  dLu  ,  dn  dL^ 
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+ 


dLi. 
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(A.  16) 
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+  S 


dT2  dLd 


AOD~ 


dAOD dAOD 

,  c  c  f  dT2  dLd  dT2  dLd  ' 

+  H20  aitP{H20,ait)  [dH^odalt  ^  daltdH20, 
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I  Q  Q  f  did  ,  dT2  did  \ 

+  H2O  A0DP(H20,A0D)  qj^qjj  +  j 

.  e  ^  ( dT2  did  dT2  did 

+  alt  ^ODPialt,AOD)yQ^l^g^Qj^  + 

(A.17) 


2  dT2  dLu  2  dT2  dLu  2  9t2  dLu 

dH20  dH20  ^  dalt  dalt  ^  dAOD  dAOD 

a  c  (  dT2  dLu  dT2  dLu  \ 

H2O  aitP{H20,ait)  \QH.20dalt  ^  dalt  dH20 ) 

n  n  (  dT2  dLu  dT2  dLu  \ 

H2O  aodP(H20,aod)  [gH^odAOD  ^  dAODdH2o) 

c,  c-  f  ,  ^'^2  dLu\ 

alt  AODP{ait,AOD)  \QaitdAOD  ^  dAOD  dalt) 

(A.  18) 


Q  Q  _  q2  dLd  dLu  „2  dLd  dLu  „2  dLd  dLu 

id  LuPiLuLu)  -  H2O dAOD  dAOD 

n  n  f  dLd  dLu  dLd  dLu  \ 

+  H2O  altP{H20,alt)  [dH20^  ^  ^t  dH20) 

,  a  o  .  f  dLd  dLu  ^  dLd  dLu  \ 

+  H2O  A0DP(H20,A0D)  yQ^^Q  Qj^QJJ  +  QH2O) 

^  ^  fdLd  dLu  ^  dLd  dLu\ 

+  alt  AODp{alt,AOD)  g^^^  j 

(A.  19) 

Equations  A.20  through  A.23  show  how  the  error  in  eaeh  individual  modeling 
term  is  determined.  The  earlier  note  on  how  the  pieee  eomponents  are  obtained 
applies  here  as  well. 
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(A.20) 
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(A.23) 


A.3  Consolidated  expressions 

The  following  equation  is  the  final  expanded  form  of  governing  equation  4.20.  It 
does  not  explieitly  incorporate  equations  A.  14  through  A.  15  or  A.20  through  A.23, 
which  cannot  be  analytically  expanded  any  further. 
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Let  the  eonstant  k  be  assigned  to  the  denominator  of  equation  4.18: 


E 

k  =  —  cos  as'TiT2  +  {F2  {FiLd  +  (1  -  Fi)  Ldd)  +  (1  -  F2)  Lbkg)  T2  (A.25) 

TT 

The  following  is  a  simplified  form  of  equation  A.24,  albeit  one  that  does  not 
permit  eonvenient  eonneetion  between  error  sourees  and  terms  in  the  equation: 


(A.24) 
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A.4  Digital  elevation  model  altitude  error 


The  following  set  of  equations  provides  a  model  for  altitude  error  given  a  regularly- 
gridded  digital  elevation  model  (DEM).  In  this  development,  the  DEM  grid  loea- 
tions  are  at  Xn  and  where  n  represents  the  grid  loeation  in  figure  4.9(b), 
with  Zn  representing  the  eorresponding  datum.  Einear  interpolation  to  a  ground 
loeation  (x,  y)  produees  the  eoordinate  triplet  (x,  y,  z).  The  A  terms  are  eom- 
mon  linear  interpolation  notation,  and  the  A  terms  simply  represent  the  indieated 
differenees.  The  S  terms  represent  random  uneertainty  in  the  subseripted  variable. 
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Water  vapor  mean 
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Climatology  Analysis  Results 


Water  vapor,  GPS,  Buffalo  NY 


Water  vopor,  GPS,  Buffalo  NY 


(a)  all  data 


(b)  summary  data 


Figure  B.l:  GPS -based  climate  model  for  water  vapor 
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Water  vapor,  radiosonde,  Buffalo  NY 


Water  vapor,  radiosonde,  Buffalo  NY 


(a)  all  data  (b)  summary  data 

Figure  B.2:  Radiosonde-based  climate  model  for  water  vapor 


Water  Vapor  Mean,  MODIS,  BUF 


Water  Vapor  Mean,  MODIS,  BUF 


(a)  all  data 


(b)  summary  data 


Figure  B.3:  MODIS-based  climate  model  for  water  vapor 


Density  altitude  datum  mean  (km)  Density  altitude  datum  meon  (km) 
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Density  altitude  datum,  obs,  Buffalo  NY 


(a)  all  data 


(b)  summary  data 


Figure  B.4:  Airport  observation-based  climate  model  for  density  altitude 


Density  altitude  datum,  GPS,  Buffalo  NY 


JFMAMJJASOND 

Month 


(a)  all  data 


(b)  summary  data 


Figure  B.5:  GPS-based  climate  model  for  density  altitude. 
Note  the  lack  of  data  between  June  and  November 


Density  altitude  datum  mean  (km) 
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Density  altitude  datum,  radiosonde,  Buffalo  NY  Density  altitude,  radiosonde,  Buffalo  NY 


(a)  all  data  (b)  summary  data 

Figure  B.6:  Radiosonde-based  climate  model  for  density  altitude 


Optical  Depth  Mean,  MODIS,  BUF  Optical  Depth  Mean,  MODIS,  BUF 


(a)  all  data 


(b)  summary  data 


Figure  B.7:  MODIS-based  climate  model  for  aerosols 


Density  altitude  datum  mean  (km) 
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visibility  obs,  Buffalo  NY  Visibility  obs,  Buffalo  NY 


(a)  all  data  (b)  summary  data 

Figure  B.8:  Airport  observation-based  climate  model  for  visibility 


Figure  B.9:  Airport  observation-based  visibility  histogram 
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Upwelled  radiance  (W/cm2  nm  sr) 
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Radiance  variation,  792m 


(a)  sensor  at  792  m 
Radiance  at  792m,  %  diff 


(c)  %  diff,  sensor  at  792  m 


Transmissivity  variation,  792m 


(b)  T2,  sensor  at  792  m 
Transmissivity  at  792m,  %  diff 


(d)  T2,  %  diff,  sensor  at  792  m 


Figure  C.l:  Radiance  and  transmission  variation  due  to  off-nadir  pointing  at  selected  wavelengths. 
Line  color  corresponds  to  blue  (450  nm),  green  (550  nm),  and  red  (650  nm)  wavelengths. 


Upwelled  radiance  (W/cm2  nm  sr) 
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Radiance  variation,  4km 


(a)  Lu,  sensor  at  4  km 
Radiance  at  4km,  %  diff 


(c)  Lu,  %  diff,  sensor  at  4  km 


Transmissivity  variation,  4km 


(b)  T2,  sensor  at  4  km 


Transmissivity  at  4km,  %  diff 


(d)  T2,  %  diff,  sensor  at  4  km 


Figure  C.2:  Radiance  and  transmission  variation  due  to  off-nadir  pointing  at  selected  wavelengths. 
Line  color  corresponds  to  blue  (450  nm),  green  (550  nm),  and  red  (650  nm)  wavelengths. 


Upwelled  rodionce  (W/cm2  nm  sr) 
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Radiance  variation,  11km 


(a)  sensor  at  1 1  km 


Radiance  at  11km,  %  diff 


(c)  L„,  %  diff,  sensor  at  11  km 


Transmissivity  variation,  11km 


(b)  T2,  sensor  at  1 1  km 

Transmissivity  at  11km,  %  diff 


(d)  T2,  %  diff,  sensor  at  1 1  km 


Figure  C.3:  Radiance  and  transmission  variation  due  to  off-nadir  pointing  at  selected  wavelengths. 
Line  color  corresponds  to  blue  (450  nm),  green  (550  nm),  and  red  (650  nm)  wavelengths. 


Upwelled  rodionce  (W/cm2  nm  sr) 
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Radiance  variation,  100km 


(a)  Lu,  sensor  at  100  km 


Radiance  at  100km,  %  diff 


(c)  Lu,  %  diff,  sensor  at  100  km 


Transmissivity  variation,  100km 


(b)  T2,  sensor  at  100  km 

Transmissivity  at  100km,  %  diff 


(d)  T2,  %  diff,  sensor  at  100  km 


Figure  C.4:  Radiance  and  transmission  variation  due  to  off-nadir  pointing  at  selected  wavelengths. 
Line  color  corresponds  to  blue  (450  nm),  green  (550  nm),  and  red  (650  nm)  wavelengths. 


Upwelled  rodlonce  (W/cm2  nm  sr] 
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Radiance  variation,  100km  Radiance  variation,  100km 


(a)  Upwelled  radiance,  DISORT 


Radiance  at  100km,  %  diff 


(b)  Upwelled  radiance,  2-stream 
Radiance  at  100km,  %  diff 


(c)  Upwelled  radiance  %  diff,  DISORT 


(d)  Upwelled  radiance  %  diff,  2-stream 


Figure  C.5:  Multiple  scattering  algorithm  effect  on  off-nadir  pointing,  shown  at  100  km  altitude. 

Line  color  corresponds  to  blue  (450  nm),  green  (550  nm),  and  red  (650  nm)  wavelengths.  A 
discrepancy  of  approximately  1%  is  visible  for  the  450  nm  curve.  Transmissivity  is  not  affected  in 

MODTRAN’s  implementation. 
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0  500  1000  1500  2000  2500 

Wavelength  (nm) 


0  500  1000  1500  2000  2500 

Wavelength  (nm) 


(a)  Change  in  Ld  by  #  cloud  quads 
Percent  RMS  deviation  by  quad  coverage 
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(d)  Pet  change  in  Ld  by  cloudy  sky  fraction 


Figure  C.6:  Cumulus  cloud  modeling  results  using  72  total  sky  quads,  with  up  to  40  filled  with 
absorbing,  scattering,  and  reflecting  clouds.  For  figures  C.6(a)  and  C.6(c),  the  smallest  curve  cor¬ 
responds  to  1  filled  quad,  increasing  to  40  filled  quads  for  the  largest  curve.  For  figures  C.6(b)  and 
C.6(d),  the  smallest  curve  corresponds  to  a  0-5%  cloud  cover  bin,  with  bin  value  increasing  by  5% 
per  curve  to  a  maximum  bin  size  of  45-50%  cloud  cover. 
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Percent  RMS  deviation  by  sky  fraction 


(a)  Pet  change  in  Ld,  altostratus 
Percent  RMS  deviation  by  sky  fraction 


(b)  Pet  change  in  Ld,  stratus 


Figure  C.7:  Comparison  between  cumulus  with  stratus  cloud  types  for  effect  on 
Lrf.  Compare  to  figure  C.6(d).  The  smallest  curve  corresponds  to  a  0-5%  cloud 
cover  bin,  with  bin  value  increasing  by  5%  per  curve  to  a  maximum  bin  size  of 

45-50%  cloud  cover. 
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Figure  C.8:  Background  object  modeling  results  using  72  total  sky  quads,  with  up  to  12  filled  with 
a  linearly-mixed  composite  background  object.  For  figures  C.8(a)  and  C.8(c),  the  smallest  curve 
corresponds  to  1  filled  quad,  increasing  to  12  filled  quads  for  the  largest  curve.  For  figures  C.8(b) 
and  C.8(d),  the  smallest  curve  corresponds  to  a  bin  of  0-5%  sky  masked  by  terrain,  with  bin  value 
increasing  by  5%  per  curve  to  a  maximum  bin  size  of  20-25%  terrain  masking. 


Appendix  D 

Atmospheric  Uncertainty  Results 


This  appendix  contains  results  for  the  atmospheric  uncertainty  scenarios  listed  in 
table  5.8.  The  legend  below  gives  the  color  coding  of  the  component  curves.  Each 
scenario  was  fun  for  a  100%  reflector  and  a  20%  reflector.  Results  include  a  plot 
showing  random  reflectance  error  (along  with  the  contributions  from  each  model¬ 
ing  output)  and  a  plot  showing  all  of  the  individual  correlation  terms.  Figure  D.l 
is  the  color  legend  for  the  reflectance  error  plots,  and  figure  D.2  is  the  color  legend 
for  the  correlation  plots. 
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Figure  D.l:  Legend  for  reflectance  results 
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Figure  D.2:  Legend  for  correlation  results 


219 


Reflectance  error  by  contributor 
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(a)  100%  reflector 


Reflectance  error  by  contributor 
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Figure  D.3:  Scenario  1  {a  priori  knowledge  climatology  inputs)  -  Total  reflectance 
uncertainty  (black  curve)  and  contributing  factors.  Color  coding  for  contributors: 
red  =  Ti,  green  =  T2,  blue  =  L^,  cyan  =  L^,  and  violet  =  sum  of  all  correlation 

terms.  Also  see  figure  D.l. 
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Correlation  terms 


(a)  100%  reflector 

Correlation  terms 


(b)  20%  reflector 

Figure  D.4:  Scenario  1  {a  priori  knowledge  climatology  inputs)  -  Individual  cor¬ 
relation  terms  alongside  total  reflectance  uncertainty  (black  curve).  Color  coding 
for  correlations:  green  =  p(ruT2)’  red  =  p(^ri,LA’  blue  =  P(ri,L„)>  yellow  =  P^l^^lA’ 
cyan  =  P(r2,Ld)’  ^"^d  magenta  =  P(r2,Ln)  -^Iso  bgure  D.2. 
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Reflectance  error  by  contributor 


(a)  100%  reflector 

Reflectance  error  by  contributor 


(b)  20%  reflector 

Figure  D.5:  Scenario  2  (inputs  from  commercial  quality  instrumentation)  -  Total 
reflectance  uncertainty  (black  curve)  and  contributing  factors.  Color  coding  for 
contributors:  red  =  ti,  green  =  T2,  blue  =  cyan  =  Lu,  and  violet  =  sum  of  all 
correlation  terms.  Also  see  figure  D.l. 
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Correlation  terms 


(a)  100%  reflector 

Correlation  terms 


(b)  20%  reflector 

Figure  D.6:  Scenario  2  (inputs  from  commercial  quality  instrumentation)  -  Indi¬ 
vidual  correlation  terms  alongside  total  reflectance  uncertainty  (black  curve).  Color 
coding  for  correlations:  green  =  P(.ri,T2)>  red  =  P(ruLA’  =  PUuLA’  yellow  = 
P{La,Lu)’  eyan  =  P(r2,Ld)’  magenta  =  P(r2,Lu)  Also  see  figure  D.2. 
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Reflectance  error  by  contributor 


(a)  100%  reflector 

Reflectance  error  by  contributor 


(b)  20%  reflector 

Figure  D.7:  Scenario  3  (inputs  from  ARM-grade  instrumentation)  -  Total  re¬ 
flectance  uncertainty  (black  curve)  and  contributing  factors.  Color  coding  for  con¬ 
tributors:  red  =  Ti,  green  =  T2,  blue  =  L^,  cyan  =  L^,  and  violet  =  sum  of  all 
correlation  terms.  Also  see  figure  D.l. 
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(a)  100%  reflector 

Correlation  terms 


(b)  20%  reflector 


Figure  D.8:  Scenario  3  (inputs  from  ARM-grade  instrumentation)  -  Individual  cor¬ 
relation  terms  alongside  total  reflectance  uncertainty  (black  curve).  Color  coding 
for  correlations:  green  =  p(ruT2)’  red  =  p(^ri,LA’  blue  =  P(ri,L„)>  yellow  =  P^l^^lA’ 
cyan  =  P(r2,Ld)’  ^"^d  magenta  =  P(r2,Ln)  -^Iso  bgure  D.2. 
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Reflectance  error  by  contributor 


(a)  100%  reflector 

Reflectance  error  by  contributor 


(b)  20%  reflector 

Figure  D.9:  Scenario  4  (wet  atmosphere  model  inversion  results)  -  Total  re¬ 
flectance  uncertainty  (black  curve)  and  contributing  factors.  Color  coding  for  con¬ 
tributors:  red  =  Ti,  green  =  T2,  blue  =  L^,  cyan  =  L^,  and  violet  =  sum  of  all 
correlation  terms.  Also  see  figure  D.l. 
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Figure  D.  10:  Scenario  4  (wet  atmosphere  model  inversion  results)  -  Individual  cor¬ 
relation  terms  alongside  total  reflectance  uncertainty  (black  curve).  Color  coding 
for  correlations:  green  =  pi^ruT2y  ^ed  =  blue  =  y^How  = 

cyan  =  P(r2,La)’  and  magenta  =  P(r2,Ln)  Also  see  figure  D.2. 
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Reflectance  error  by  contributor 


(a)  100%  reflector 

Reflectance  error  by  contributor 


(b)  20%  reflector 

Figure  D.ll:  Scenario  5  (dry  atmosphere  model  inversion  results)  -  Total  re¬ 
flectance  uncertainty  (black  curve)  and  contributing  factors.  Color  coding  for  con¬ 
tributors:  red  =  Ti,  green  =  T2,  blue  =  L^,  cyan  =  L^,  and  violet  =  sum  of  all 
correlation  terms.  Also  see  figure  D.l. 


228 


APPENDIX  D.  ATMOSPHERIC  UNCERTAINTY  RES  UETS 


Correlation  terms 


(a)  100%  reflector 

Correlation  terms 


(b)  20%  reflector 


Figure  D.  12:  Scenario  5  (dry  atmosphere  model  inversion  results)  -  Individual  cor¬ 
relation  terms  alongside  total  reflectance  uncertainty  (black  curve).  Color  coding 
for  correlations:  green  =  p(ruT2)’  red  =  p(^ri,LA’  blue  =  P(ri,L„)>  yellow  =  P^l^^lA’ 
cyan  =  P(r2,Ld)’  ^"^d  magenta  =  P(r2,Ln)  -^Iso  bgure  D.2. 


Appendix  E 

Environmental  Effect  Results 


This  appendix  includes  total  reflectance  uncertainty  and  bias  for  several  major  en¬ 
vironmental  effects.  For  each  effect,  a  key  parameter  was  varied  over  a  range  of 
values,  and  the  final  reflectance  results  were  combined  on  a  single  plot  for  com¬ 
parison  purposes.  There  is  no  significance  to  the  colors  in  these  plots  other  than 
to  provide  visual  distinction  between  curves.  The  black  curves  generally  represent 
the  most  extreme  value  of  the  set. 
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Figure  E.l:  Scenarios  6-8,  bias  error  for  a  100%  reflector  caused  by  off-nadir  pointing  effects 
Nadir  angles  are  0°,  3°,  6°,  9°,  12°,  and  15° 
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Figure  E.2:  Scenarios  6-8,  bias  error  for  a  20%  reflector  caused  by  off-nadir  pointing  effects 
Nadir  angles  are  0°,  3°,  6°,  9°,  12°,  and  15° 


Reflectance  (0.0- 1.0)  Reflectonce  (0.0- 1.0) 


232 


APPENDIX  E.  ENVIRONMENTAE  EEEECT  RES  VETS 


Error  in  overall  reflectance  by  input 


500  1000  1500  2000  2500 


Wovelength  (nm) 

(a)  Nadir,  100%  reflector 


500  1000  1500  2000  2500 

Wovelength  (nm) 


(c)  15°  off-nadir,  100%  reflector 


Error  in  overall  reflectance  by  input 


500  1000  1500  2000  2500 

Wovelength  (nm) 


(b)  Nadir,  20%  reflector 


Error  In  overall  reflectance  by  input 


500  1000  1500  2000  2500 

Wavelength  (nm) 


(d)  15°  off-nadir,  20%  reflector 


Figure  E.3:  Scenarios  9-10,  random  error  caused  by  pointing  angle  uncertainty. 
Note  that  off-nadir  bias  error  is  not  shown,  but  it  is  consistent  with  figure  E.  1 . 
Pointing  uncertainty  is  0°,  0.2°,  0.4°,  0.6°,  0.8°,  and  1.0° 
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Figure  E.4:  Scenario  11,  bias  error  caused  by  ground  tilt 
Ground  tilt  (angle  from  normal)  is  0°,  3°,  6°,  9°,  12°,  and  15' 
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Figure  E.5:  Scenarios  12-13,  random  error  caused  by  ground  tilt  angle 
uncertainty.  Note  that  bias  error  is  not  shown,  but  it  is  consistent  with  figure  E.4. 
Ground  tilt  knowledge  uncertainty  is  0°,  2°,  4°,  6°,  8°,  and  10° 
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Figure  E.6:  Scenarios  14-15,  cloud  object  bias  error,  for  a  100%  reflector.  The 
spread  reflects  reflectance  bias  due  to  the  range  of  possible  cumulus  cloud  config¬ 
urations.  These  results  show  bias  errors  for  10%  and  20%  cloud  cover,  ±1%  and 
±5%,  over  a  spectrally  flat  ground  target  with  100%  reflectance 
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Figure  E.7:  Scenarios  14-15,  cloud  object  bias  error,  for  a  20%  reflector.  The 
spread  reflects  reflectance  bias  due  to  the  range  of  possible  cumulus  cloud  config¬ 
urations.  These  results  show  bias  errors  for  10%  and  20%  cloud  cover,  ±1%  and 
±5%,  over  a  spectrally  flat  ground  target  with  20%  reflectance 
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Figure  E.8:  Scenarios  16-17,  background  object  bias  error,  for  a  100%  reflector. 
The  spread  reflects  reflectance  bias  due  to  the  range  of  possible  low-elevation  back¬ 
ground  object  configurations.  These  results  show  bias  errors  for  10%  and  20% 
terrain  masking,  ±1-2%  and  ±5%,  over  a  spectrally  flat  ground  target  with  100% 

reflectance 


d(reflectonce)  d(reflectQnce) 


238 


APPENDIX  E.  ENVIRONMENTAE  EEEECT  RES  VETS 


background-induced  Reflectance  Deviation 


background— induced  Reflectonce  Deviation 


Wavelength  (nm) 

(a)  10%  coverage  zb  1%  knowledge 


1000  1500  2000 

Wavelength  (nm) 


(b)  10%  coverage  ±5%  knowledge 


background-induced  Reflectance  Deviation 


Wavelength  (nm) 


(c)  20%  coverage  ±2%  knowledge 


background-induced  Reflectonce  Deviation 
0.002  c — I — ' — ' — ' — ' — I — ' — ' — ' — ' — I — ' — ' — ' — ' — I — ' — 


0.001 


-0.002 


-0.003  r  I  ,  ,  ,  ,  I  ,  ,  ,  ,  I  ,  ,  ,  ,  I  ,  ,  ,  ,  - 

500  1000  1500  2000  2500 

Wavelength  (nm) 


(d)  20%  coverage  ±5%  knowledge 


Figure  E.9:  Scenarios  16-17,  background  object  bias  error,  for  a  20%  reflector.  The 
spread  reflects  reflectance  bias  due  to  the  range  of  possible  low-elevation  back¬ 
ground  object  configurations.  These  results  show  bias  errors  for  10%  and  20% 
terrain  masking,  ±1-2%  and  ±5%,  over  a  spectrally  flat  ground  target  with  20% 

reflectance 
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Error  in  overall  reflectance  by  input 
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Figure  E.IO:  Scenario  18,  sensor  noise  random  error 
AVIRIS  (red),  HYDICE  (blue),  and  Hyperion  (black)  are  shown  here 
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(a)  100%  reflector  (b)  20%  reflector 


Figure  E.  11:  Scenario  19,  sensor  radiometric  calibration  bias  error.  Bias  estima¬ 
tion  results  from  the  2002  AVIRIS  study  (red)  and  a  straight  —3%  bias  based  on 
Hyperion  validation  study  (black)  are  shown  here. 
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Figure  E.12:  Scenario  20,  retrieved  reflectance  bias  error  due  to  spectral  misregis¬ 
tration 
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Reflectance  uncertainty 


Figure  E.  1 3 :  Scenario  2 1 ,  uncertainty  in  retrieved  reflectance  due  to  0.5  nm  spectral 

jitter 


Appendix  F 

Validation  Results 


This  appendix  contains  results  for  the  validation  scenarios  listed  in  table  4.5.  Each 
curve  shows  the  standard  deviation  of  total  reflectance  uncertainty  as  calculated 
from  results  generated  using  randomly  perturbed  input  variables,  as  described  in 
section  4.15. 
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Validation  Reflectance  Error  Predicted  reflectance  error 


(a)  Validation  result 

Total  Error  Difference  -  Predicted  vs  Validation 


(b)  Model  prediction 
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(c)  Absolute  difference 
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Figure  F.l:  Validation  scenario  1  -  100%  reflector.  Target  water  vapor  uncertainty 
was  0.2.  Actual  uncertainty  was  0.199.  The  error  propagation  model  input  was 
adjusted  to  match  the  actual  uncertainty. 
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Validation  Reflectance  Error 


(a)  Validation  result 

Total  Error  Difference  -  Predicted  vs  Validation 


(c)  Absolute  difference 
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Figure  F.2:  Validation  scenario  1  -  20%  reflector.  Target  water  vapor  uncertainty 
was  0.2  cm.  Actual  uncertainty  was  0.202  cm.  The  error  propagation  model  input 
was  adjusted  to  match  the  actual  uncertainty. 
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Validation  Reflectance  Error 


(a)  Validation  result 
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(b)  Model  prediction 

Percent  Difference  -  Predicted  vs  Validation 
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Figure  F.3:  Validation  scenario  2  -  100%  reflector.  Target  water  vapor  uncertainty 
was  0. 1  cm.  Actual  uncertainty  was  0. 1  cm.  The  error  propagation  model  input 
was  adjusted  to  match  the  actual  uncertainty. 
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Validation  Reflectance  Error 


(a)  Validation  result 

Total  Error  Difference  -  Predicted  vs  Validation 


Predicted  reflectance  error 


(b)  Model  prediction 
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Figure  F.4:  Validation  scenario  2  -  20%  reflector.  Target  water  vapor  uncertainty 
was  0.1  cm.  Actual  uncertainty  was  0.099  cm.  The  error  propagation  model  input 
was  adjusted  to  match  the  actual  uncertainty. 
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Validation  Reflectance  Error 


(a)  Validation  result 
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(c)  Absolute  difference 
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Figure  F.5:  Validation  scenario  3  -  100%  reflector.  Target  water  vapor  uncertainty 
was  0.2  cm.  Actual  uncertainty  was  0.19  cm.  The  error  propagation  model  input 
was  adjusted  to  match  the  actual  uncertainty. 
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Validation  Reflectance  Error 


(a)  Validation  result 

Total  Error  Difference  -  Predicted  vs  Validation 
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(b)  Model  prediction 
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Figure  F.6:  Validation  scenario  3  -  20%  reflector.  Target  water  vapor  uncertainty 
was  0.2  cm.  Actual  uncertainty  was  0. 196  cm.  The  error  propagation  model  input 
was  adjusted  to  match  the  actual  uncertainty. 
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Validation  Reflectance  Error 


(a)  Validation  result 

Total  Error  Difference  -  Predicted  vs  Validation 


Predicted  reflectance  error 


(b)  Model  prediction 
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(c)  Absolute  difference  (d)  Percent  difference 

Figure  F.7:  Validation  scenario  4  -  100%  reflector.  Target  water  vapor  uncertainty 
was  0. 1  cm.  Actual  uncertainty  was  0.0.098  cm.  The  error  propagation  model 
input  was  adjusted  to  match  the  actual  uncertainty. 
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Validation  Reflectance  Error  Predicted  reflectance  error 


(a)  Validation  result 

Total  Error  Difference  -  Predicted  vs  Validation 


(b)  Model  prediction 
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Figure  F.8:  Validation  scenario  4  -  20%  reflector.  Target  water  vapor  uncertainty 
was  0.1  cm.  Actual  uncertainty  was  0.1001  cm.  The  error  propagation  model 
input  was  adjusted  to  match  the  actual  uncertainty. 
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Validation  Reflectance  Error  Predicted  reflectance  errcr 


(a)  Validation  result 

Total  Error  Difference  -  Predicted  vs  Validation 


(b)  Model  prediction 
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(c)  Absolute  difference  (d)  Percent  difference 

Figure  F.9:  Validation  scenario  5  -  100%  reflector.  Target  density  altitude 
uncertainty  was  0.02  km.  Actual  uncertainty  was  0.02  km.  The  error  propagation 
model  input  was  adjusted  to  match  the  actual  uncertainty. 
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Validotion  Reflectonce  Error  Predicted  reflectance  error 


(a)  Validation  result 
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Figure  F.IO:  Validation  scenario  5  -  20%  reflector.  Target  density  altitude 
uncertainty  was  0.02  km.  Actual  uncertainty  was  0.0214  km.  The  error 
propagation  model  input  was  adjusted  to  match  the  actual  uncertainty. 
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Validation  Reflectance  Error  Predicted  reflectance  error 


(a)  Validation  result 

Total  Error  Difference  -  Predicted  vs  Validation 


(b)  Model  prediction 
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Figure  F.l  1:  Validation  scenario  6  -  100%  reflector.  Target  density  altitude 
uncertainty  was  0.01  km.  Actual  uncertainty  was  0.0098  km.  The  error 
propagation  model  input  was  adjusted  to  match  the  actual  uncertainty. 
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Validation  Reflectance  Error  Predicted  reflectance  error 


(a)  Validation  result 

Total  Error  Difference  -  Predicted  vs  Validation 


(b)  Model  prediction 


Percent  Difference  -  Predicted  vs  Validation 


(c)  Absolute  difference  (d)  Percent  difference 

Figure  F.12:  Validation  scenario  6  -  20%  reflector.  Target  density  altitude 
uncertainty  was  0.01  km.  Actual  uncertainty  was  0.0099  km.  The  error 
propagation  model  input  was  adjusted  to  match  the  actual  uncertainty. 
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Figure  F.13:  Validation  scenario  7  -  100%  reflector.  Target  aerosol  optical  depth 
uncertainty  was  0.04.  Actual  uncertainty  was  0.04218.  The  error  propagation 
model  input  was  adjusted  to  match  the  actual  uncertainty. 
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Validation  Reflectance  Error 


(a)  Validation  result 

Total  Error  Difference  -  Predicted  vs  Validation 


(c)  Absolute  difference 


Predicted  reflectance  error 


(b)  Model  prediction 

Percent  Difference  -  Predicted  vs  Validation 


(d)  Percent  difference 


Figure  F.14:  Validation  scenario  7  -  20%  reflector.  Target  aerosol  optical  depth 
uncertainty  was  0.04.  Actual  uncertainty  was  0.0411.  The  error  propagation 
model  input  was  adjusted  to  match  the  actual  uncertainty. 
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(a)  Validation  result 
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Figure  F.15:  Validation  scenario  8  -  100%  reflector.  Target  aerosol  optical  depth 
uncertainty  was  0.02.  Actual  uncertainty  was  0.0205.  The  error  propagation 
model  input  was  adjusted  to  match  the  actual  uncertainty. 
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Validotion  Reflectonce  Error  Predicted  reflectance  error 
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Figure  F.16:  Validation  scenario  8  -  20%  reflector.  Target  aerosol  optical  depth 
uncertainty  was  0.02.  Actual  uncertainty  was  0.021.  The  error  propagation  model 
input  was  adjusted  to  match  the  actual  uncertainty. 
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Figure  F.17:  Validation  scenario  9  -  100%  reflector.  Target  parameter 
uncertainties  were  0.2  cm,  0.045  km,  and  0.04.  Actual  uncertainty  was  0.196  cm, 
0.039  km,  and  0.0452.  The  error  propagation  model  inputs  were  adjusted  to 
match  the  actual  uncertainties. 


Reflectonce  (0-1.0)  Reflectonce  (0-1.0) 


261 


Validation  Reflectonce  Error 


(a)  Validation  result 
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Figure  F.  18:  Validation  scenario  9  -  20%  reflector.  Target  parameter  uncertainties 
were  0.2  cm,  0.045  km,  and  0.04.  Actual  uncertainty  was  0.2  cm,  0.045  km,  and 
0.04.  The  error  propagation  model  inputs  were  adjusted  to  match  the  actual 

uncertainties. 


Appendix  G 

Error  Improvement  Sensitivity 
Results 


This  appendix  shows  the  results  of  an  error  sensitivity  study  conducted  to  directly 
trace  the  error  contributions  of  each  atmospheric  constituent.  Figure  G.  1  shows  the 
color  significance  for  the  following  plots.  The  fourth  item  on  the  legend  is  not  part 
of  the  constituent  study,  rather  it  shows  the  effect  of  adding  a  sky  radiometer  with 
3%  broadband  precision  (Michalsky,  2001)  to  a  truth-assisted  inversion  network. 
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Figure  G.  1 :  Legend  for  error  sensitivity  results 
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Error  contributions  of  individual  constituents 
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Figure  G.2:  Scenario  I  -  a  priori  knowledge  climatology  inputs.  Each  curve  is  the 
percent  reduction  in  uncertainty  when  a  constituent  is  set  to  zero.  In  other  words, 
the  strength  of  each  constituent’s  error  contribution  is  judged  by  the  improvement 
gained  when  it  is  perfectly  known.  Red  =  altitude,  green  =  aerosols,  and  blue  = 
water  vapor.  Magenta  shows  the  improvement  resulting  from  the  direct  ground 
measurement  of  ti  and  L^.  Also  see  figure  G.  1. 
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Error  in  overall  reflectance  by  input 


(a)  Zero  aerosol  error  (water  vapor  error  only) 

Error  in  overall  reflectance  by  input 


(b)  Zero  water  vapor  error  (aerosol  error  only) 


Figure  G.3:  Scenario  1  -  multiple  reflectance  comparison.  Each  curve  represents 
a  different  surface  reflectance,  ranging  from  0%  (black)  to  20%  (red),  40%  (blue), 
60%  (magenta),  80%  (orange),  and  100%  (sea  green)  in  20%  increments. 
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Reflectance  error  by  contributor 
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Figure  G.4:  Scenario  1  -  individual  results  for  zero  aerosol  error  (water  vapor  error 
only).  These  plots  use  the  legend  in  figure  D.l.  Color  coding  for  contributors:  red 
=  Ti,  green  =  T2,  blue  =  L^,  cyan  =  L^,  and  violet  =  sum  of  all  correlation  terms. 
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Reflectance  error  by  contributor 
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Figure  G.5 :  Scenario  1  -  individual  results  for  zero  water  vapor  error  (aerosol  error 
only).  These  plots  use  the  legend  in  figure  D.l.  Color  coding  for  contributors:  red 
=  Ti,  green  =  T2,  blue  =  L^,  cyan  =  L^,  and  violet  =  sum  of  all  correlation  terms. 
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Error  contributions  of  individual  constituents  Error  contributions  of  individual  constituents 
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Figure  G.6:  Scenario  2  -  inputs  from  commercial  quality  instrumentation.  Each 
curve  is  the  percent  reduction  in  uncertainty  when  a  constituent  is  set  to  zero.  In 
other  words,  the  strength  of  each  constituent’s  error  contribution  is  judged  by  the 
improvement  gained  when  it  is  perfectly  known.  Red  =  altitude,  green  =  aerosols, 
and  blue  =  water  vapor.  Magenta  shows  the  improvement  resulting  from  the  direct 
ground  measurement  of  ti  and  L^-  Also  see  figure  G.  1. 
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Error  in  overall  reflectance  by  input 


(a)  Zero  aerosol  error  (water  vapor  error  only) 
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(b)  Zero  water  vapor  error  (aerosol  error  only) 

Figure  G.7:  Scenario  2  -  multiple  reflectance  comparison.  Each  curve  represents 
a  different  surface  reflectance,  ranging  from  0%  (black)  to  20%  (red),  40%  (blue), 
60%  (magenta),  80%  (orange),  and  100%  (sea  green)  in  20%  increments. 
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Figure  G.8:  Scenario  2  -  individual  results  for  zero  aerosol  error  (water  vapor  error 
only).  These  plots  use  the  legend  in  figure  D.l.  Color  coding  for  contributors:  red 
=  Ti,  green  =  T2,  blue  =  L^,  cyan  =  L^,  and  violet  =  sum  of  all  correlation  terms. 
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Reflectance  error  by  contributor 
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Figure  G.9:  Scenario  2  -  individual  results  for  zero  water  vapor  error  (aerosol  error 
only).  These  plots  use  the  legend  in  figure  D.l.  Color  coding  for  contributors:  red 
=  Ti,  green  =  T2,  blue  =  L^,  cyan  =  L^,  and  violet  =  sum  of  all  correlation  terms. 
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Figure  G.IO:  Scenario  3  -  inputs  from  ARM-grade  instrumentation.  Each  curve 
is  the  percent  reduction  in  uncertainty  when  a  constituent  is  set  to  zero.  In  other 
words,  the  strength  of  each  constituent’s  error  contribution  is  judged  by  the  im¬ 
provement  gained  when  it  is  perfectly  known.  Red  =  altitude,  green  =  aerosols, 
and  blue  =  water  vapor.  Magenta  shows  the  improvement  resulting  from  the  direct 
ground  measurement  of  ti  and  L^-  Also  see  figure  G.  1. 
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Error  in  overall  reflectance  by  input 
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Figure  G.ll:  Scenario  3  -  multiple  reflectance  comparison.  Each  curve  represents 
a  different  surface  reflectance,  ranging  from  0%  (black)  to  20%  (red),  40%  (blue), 
60%  (magenta),  80%  (orange),  and  100%  (sea  green)  in  20%  increments. 
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Figure  G.12:  Scenario  3  -  individual  results  for  zero  aerosol  error  (water  vapor 
error  only).  These  plots  use  the  legend  in  figure  D.l.  Color  coding  for  contributors: 
red  =  Ti,  green  =  T2,  blue  =  L^,  cyan  =  L^,  and  violet  =  sum  of  all  correlation  terms. 
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Reflectance  error  by  contributor 
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Figure  G.13:  Scenario  3  -  individual  results  for  zero  water  vapor  error  (aerosol 
error  only).  These  plots  use  the  legend  in  figure  D.l.  Color  coding  for  contributors: 
red  =  Ti,  green  =  T2,  blue  =  L^,  cyan  =  L^,  and  violet  =  sum  of  all  correlation  terms. 
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Figure  G.14:  Scenario  4- a  priori  knowledge  climatology  inputs.  Each  curve  is  the 
percent  reduction  in  uncertainty  when  a  constituent  is  set  to  zero.  In  other  words, 
the  strength  of  each  constituent’s  error  contribution  is  judged  by  the  improvement 
gained  when  it  is  perfectly  known.  Red  =  altitude,  green  =  aerosols,  and  blue  = 
water  vapor.  Magenta  shows  the  improvement  resulting  from  the  direct  ground 
measurement  of  ti  and  L^.  Also  see  figure  G.  1. 
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Error  in  overall  reflectance  by  input 


(a)  Zero  aerosol  error  (water  vapor  error  only) 
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(b)  Zero  water  vapor  error  (aerosol  error  only) 

Figure  G.15:  Scenario  4  -  multiple  reflectance  comparison.  Each  curve  represents 
a  different  surface  reflectance,  ranging  from  0%  (black)  to  20%  (red),  40%  (blue), 
60%  (magenta),  80%  (orange),  and  100%  (sea  green)  in  20%  increments. 
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Reflectance  error  by  contributor  Reflectance  error  by  contributor 


(a)  100%  reflector 


(b)  80%  reflector 


Reflectance  error  by  contributor  Reflectonce  error  by  contributor 


(c)  60%  reflector 


Reflectance  error  by  contributor 


(d)  40%  reflector 


Reflectonce  error  by  contributor 


(e)  20%  reflector  (f)  0%  reflector 

Figure  G.16:  Scenario  4  -  individual  results  for  zero  aerosol  error  (water  vapor 
error  only).  These  plots  use  the  legend  in  figure  D.l.  Color  coding  for  contributors: 
red  =  Ti,  green  =  T2,  blue  =  L^,  cyan  =  L^,  and  violet  =  sum  of  all  correlation  terms. 
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Reflectance  error  by  contributor  Reflectance  error  by  contributor 


(a)  100%  reflector 


(b)  80%  reflector 


Reflectance  error  by  contributor  Reflectonce  error  by  contributor 


(c)  60%  reflector 

Reflectance  error  by  contributor 


(d)  40%  reflector 
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(e)  20%  reflector 


(f)  0%  reflector 


Figure  G.17:  Scenario  4  -  individual  results  for  zero  water  vapor  error  (aerosol 
error  only).  These  plots  use  the  legend  in  figure  D.l.  Color  coding  for  contributors: 
red  =  Ti,  green  =  T2,  blue  =  L^,  cyan  =  L^,  and  violet  =  sum  of  all  correlation  terms. 
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Error  contributions  of  individual  constituents 


Error  contributions  of  individual  constituents 


(a)  100%  reflector  (b)  20%  reflector 


Error  contributions  of  individual  constituents 


(c)  5%  reflector 

Figure  G.18:  Scenario  5 -a  priori  knowledge  climatology  inputs.  Each  curve  is  the 
percent  reduction  in  uncertainty  when  a  constituent  is  set  to  zero.  In  other  words, 
the  strength  of  each  constituent’s  error  contribution  is  judged  by  the  improvement 
gained  when  it  is  perfectly  known.  Red  =  altitude,  green  =  aerosols,  and  blue  = 
water  vapor.  Magenta  shows  the  improvement  resulting  from  the  direct  ground 
measurement  of  ti  and  L^.  Also  see  figure  G.  1. 
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Error  in  overall  reflectance  by  input 


(a)  Zero  aerosol  error  (water  vapor  error  only) 
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Figure  G.19:  Scenario  5  -  multiple  reflectance  comparison.  Each  curve  represents 
a  different  surface  reflectance,  ranging  from  0%  (black)  to  20%  (red),  40%  (blue), 
60%  (magenta),  80%  (orange),  and  100%  (sea  green)  in  20%  increments. 
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Reflectance  error  by  contributor  Reflectance  error  by  contributor 


(a)  100%  reflector 


(b)  80%  reflector 
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(c)  60%  reflector  (d)  40%  reflector 
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(e)  20%  reflector 
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Figure  G.20:  Scenario  5  -  individual  results  for  zero  aerosol  error  (water  vapor 
error  only).  These  plots  use  the  legend  in  figure  D.l.  Color  coding  for  contributors: 
red  =  Ti,  green  =  T2,  blue  =  L^,  cyan  =  L^,  and  violet  =  sum  of  all  correlation  terms. 
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Figure  G.21:  Scenario  5  -  individual  results  for  zero  water  vapor  error  (aerosol 
error  only).  These  plots  use  the  legend  in  figure  D.l.  Color  coding  for  contributors: 
red  =  Ti,  green  =  T2,  blue  =  L^,  cyan  =  L^,  and  violet  =  sum  of  all  correlation  terms. 
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Figure  H.l:  Derivative  dri/dalt 


Figure  H.2:  Derivative  dri/dvis 
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Figure  H.3:  Derivative  dTi/dH20 


Figure  H.4:  Derivative  dT2ldvis 
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Figure  H.5 :  Derivative  dT2  / dalt 


Figure  H.6:  Derivative  dT2/dH20 
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Figure  H.7:  Derivative  dL^/dvis 


Figure  H.8:  Derivative  dLd/dH20 
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Figure  H.9:  Derivative  dLd/dalt 


Figure  H.IO:  Derivative  dLu/dvis 
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Figure  H.ll:  Derivative  dLu/dalt 


Figure  H.12:  Derivative  dLu/ dH20 


Appendix  I 

Explanation  of  Water  Vapor 
Units 


MODTRAN  allows  the  use  of  several  different  methods  for  speeifying  water  vapor. 
The  units  for  eaeh  method  of  speeifieation  are  obseure  to  someone  not  speeializing 
in  atmospherie  researeh,  or  at  least  to  someone  more  familiar  with  imaging  seienee. 
This  short  seetion  deseribes  the  differenees  between  the  units  and  presents  methods 
of  eonversion  and  eomputation. 

The  basie  prineiple  behind  speeifying  an  amount  of  gas  is  to  isolate  it  in  a 
eolumn  defined  by  a  given  spatial  area  on  the  ground  and  stating  how  mueh  of  the 
gas  exists  in  that  eolumn  from  earth  to  spaee.  The  amount  ean  be  given  as  number 
of  moleeules,  a  volume,  a  mass,  or  a  linear  dimension. 

One  primary  unit  of  gas  measurement  is  ealled  the  Dobson  unit,  named  for 
G.M.B.  Dobson  (1889-1976),  a  pioneer  in  ozone  researeh  and  inventor  of  the 
“Dobson  Speetrometer,”  whieh  ineidentally  employs  a  type  of  band  ratio  method  to 
determine  atmospherie  ozone  eontent  (Total  Ozone  Mapping  Speetrometer  Ozone 
Processing  Team,  2007).  The  Dobson  unit  is  a  linear  dimension  based  on  a  com¬ 
pressed  column  of  gas  (assuming  no  horizontal  variation  across  the  column).  If 
all  of  the  gas  molecules  in  a  vertical  column  were  brought  to  standard  temperature 
and  pressure  (STP,  0°  C  at  1  atmosphere),  that  gas  would  occupy  a  certain  volume 
slab.  The  horizontal  dimensions  are  constrained  by  the  column  size,  say  a  square 
meter  or  square  centimeter,  and  the  vertical  dimension  of  the  volume  is  given  by 
the  Dobson  unit  (DU),  where  1  DU  equals  0.01  mm  of  vertical  thickness  (equation 
I.l).  Given  the  assumption  of  horizontal  invariance,  the  column  area  is  not  actually 
relevant  as  it  does  not  affect  the  vertical  dimension. 
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1  DU  =  0.01  mm  @  STP  (I.l) 

A  similar  unit  is  called  the  atmosphere-meter,  meter-atmosphere,  or  atmo- 
meter,  described  as  the  depth,  in  meters,  a  layer  of  gas  would  have  if  brought  to 
STP  (Rowlett).  This  definition  is  nearly  identical  to  that  for  Dobson  units  (equa¬ 
tion  1.2).  Additionally,  Rowlett  adds  that  this  is  equivalent  to  2.686  99  x  10^^ 
molecules  of  gas  per  square  meter  of  horizontal  area.  MODTRAN  uses  a  related 
unit,  the  atm-cm  for  gaseous  quantities  (equation  1.3). 

1  atm-cm  =  1000  DU  =  10  mm  @  STP  (1.2) 

1  atm-cm  =  0.01  atm-m  =  2.687  x  10^^  molecules / mi^ 

=  2.687  X  10^®  molecules /cm'^  (1.3) 

The  other  main  unit  used  by  MODTRAN  is  grams  per  square  centimeter,  or 
the  mass  of  water  vapor  contained  in  a  column  with  a  horizontal  area  of  a  square 
centimeter.  The  introduction  of  mass  now  requires  a  way  to  relate  molar  volume 
to  mass.  This  is  accomplished  using  the  molecular  mass  for  the  gas  under  study. 
Molecular  masses  for  most  gases,  including  water  vapor  and  air,  and  can  be  found 
in  standard  chemical  reference  sources  (Lide,  2003).  Equation  1.4  shows  this  con¬ 
version,  where  Na  is  Avogadro’s  number  (6.02  x  10^^  molecules  per  mole)  and 
Wh20  is  the  molecular  weight  of  water,  18.015  34  g/mol.  Substituting  equation 
1.3  into  1.4  and  combining  terms  produces  a  constant  conversion  factor  for  each 
gas.  For  water,  this  conversion  factor  is  8.038  x  10“^. 


Ip/cm^  =  1  atm-cm 


2.687  X  lO^y  •  Wh20 
Wa 


=  8.038  X  10  ^  atm-cm 


(1.4) 


Mass  per  unit  area  is  a  particularly  useful  unit  for  water  vapor  because  it  di¬ 
rectly  relates  to  the  final  water  vapor  unit  to  be  addressed,  total  or  integrated  pre- 
cipitable  water  (TPW  or  IPW).  If  all  of  the  water  vapor  in  a  specified  column  were 
fo  be  condensed,  fhe  heighf  of  fhe  resulfing  volume  of  liquid  (wifh  fhe  area  con- 
sfrained  fo  mafch  fhe  column  foolprinf)  is  fhe  IPW.  Because  liquid  wafer  has  unif 
densify,  1  cm^  of  liquid  wafer  is  equal  fo  1  g/cm?  (equation  1.5). 


1  gjcrf?  =  1  cm  IPW 


(1.5) 
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